00010000:00010000:1.0F:1788851292.982339:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1788851294.007050:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1788851294.135191:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788851294.135224:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019826176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851294.135290:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851294.135347:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019826176 00000100:00100000:2.0:1788851294.135355:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019826176 00000100:00100000:2.0:1788851294.135411:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788851294.135422:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019826176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851294.135452:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788851294.135496:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019826176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851294.135504:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788851294.135523:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851294.135556:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019826176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788851294.137689:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019826304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851294.137752:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851294.137810:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019826304 00000100:00100000:3.0:1788851294.137819:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019826304 00000100:00100000:3.0:1788851294.138247:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788851294.138256:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019826304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851294.138278:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788851294.138323:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019826304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851294.138329:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788851294.138644:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851294.138674:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019826304:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788851294.140632:0:17192:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1788851294.140651:0:17192:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff892d87beea80 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:2.0:1788851294.140657:0:17192:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892d879bb600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff892d87beee40 00000020:00080000:2.0:1788851294.140660:0:17192:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff892d879bb300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff892d86bfb200 00010000:00010000:1.0:1788851294.140752:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b207226 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851294.140763:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b207226 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851294.140772:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b207226 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851294.140778:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851294.140783:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b207226 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851294.140790:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b207226 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851294.140807:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ec1d49e00) 00010000:00010000:1.0:1788851294.140811:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851294.140815:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b207226 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851294.140896:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433c200/0x3e0030720b207226 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788851294.141030:0:17251:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:3.0:1788851294.141110:0:17251:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1788851294.148176:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019826432:0@lo:400:kworker.0 00000100:00100000:2.0:1788851294.148254:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851294.148290:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019826944:0@lo:400:kworker.0 00000100:00100000:2.0:1788851294.148315:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851294.148332:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019827456:0@lo:400:kworker.0 00000100:00100000:2.0:1788851294.148351:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851294.148373:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788851294.148378:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019826816:0@lo:400:kworker.0 00000100:00100000:2.0:1788851294.148412:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851294.148427:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019827328:0@lo:400:kworker.0 00000100:00100000:2.0:1788851294.148445:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851294.148480:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019827456 00000100:00100000:2.0:1788851294.148487:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019827456 00000100:00100000:2.0:1788851294.148539:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019826816 00000100:00100000:2.0:1788851294.148542:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019826816 00000100:00100000:2.0:1788851294.148555:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019827328 00000100:00100000:2.0:1788851294.148558:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019827328 00000100:00100000:2.0:1788851294.148574:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788851294.148581:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019827456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851294.148631:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019827456:12345-0@lo:400:kworker.0 Request processed in 50us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851294.148638:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788851294.148654:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788851294.148660:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019826816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851294.148685:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019826816:12345-0@lo:400:kworker.0 Request processed in 25us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851294.148690:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788851294.148700:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788851294.148706:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019827328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851294.148729:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019827328:12345-0@lo:400:kworker.0 Request processed in 24us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851294.148734:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788851294.148770:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019826816:0@lo:400:kworker.0 00000100:00100000:2.0:1788851294.148780:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019827328:0@lo:400:kworker.0 00010000:00080000:2.0:1788851294.148801:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea7d65880 x1875746019827456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851294.148810:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019827456:0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149038:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019826688:0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149072:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851294.149105:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019827200:0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149124:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851294.149138:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019827712:0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149154:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851294.149180:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788851294.149185:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019826560:0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149204:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851294.149220:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019827072:0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149235:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851294.149248:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019827584:0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149262:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851294.149281:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019826432 00000100:00100000:1.0:1788851294.149285:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019826432 00000100:00100000:1.0:1788851294.149310:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788851294.149316:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea6008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:3650:x1875746019826432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149341:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea6008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:3650:x1875746019826432:12345-0@lo:400:kworker.0 Request processed in 26us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851294.149346:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788851294.149373:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019826944 00000100:00100000:1.0:1788851294.149376:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019826944 00000100:00100000:1.0:1788851294.149394:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019826560 00000100:00100000:1.0:1788851294.149397:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019826560 00000100:00100000:1.0:1788851294.149407:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788851294.149411:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019826944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149438:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019826944:12345-0@lo:400:kworker.0 Request processed in 26us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851294.149443:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788851294.149453:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788851294.149458:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019826560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149484:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019826560:12345-0@lo:400:kworker.0 Request processed in 26us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851294.149497:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788851294.149512:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019827200 00000100:00100000:1.0:1788851294.149515:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019827200 00000100:00100000:1.0:1788851294.149528:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019827712 00000100:00100000:1.0:1788851294.149530:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019827712 00000100:00100000:1.0:1788851294.149540:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019827584 00000100:00100000:1.0:1788851294.149542:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019827584 00000100:00100000:1.0:1788851294.149555:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788851294.149560:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019827200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149591:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019827200:12345-0@lo:400:kworker.0 Request processed in 30us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851294.149596:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788851294.149607:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788851294.149612:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019827712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149636:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019827712:12345-0@lo:400:kworker.0 Request processed in 24us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851294.149641:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788851294.149651:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788851294.149657:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019827584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149679:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019827584:12345-0@lo:400:kworker.0 Request processed in 24us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851294.149684:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788851294.149701:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019826688 00000100:00100000:1.0:1788851294.149705:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019826688 00000100:00100000:1.0:1788851294.149728:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019827072 00000100:00100000:1.0:1788851294.149731:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019827072 00000100:00100000:1.0:1788851294.149749:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788851294.149761:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019826688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.149790:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019826688:12345-0@lo:400:kworker.0 Request processed in 30us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851294.149796:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788851294.149807:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788851294.149813:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019827072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851294.150963:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019826432:0@lo:400:kworker.0 00000100:00100000:2.0:1788851294.150982:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019826944:0@lo:400:kworker.0 00000100:00080000:2.0:1788851294.151106:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851294.151111:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851294.151114:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851294.151335:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019827072:12345-0@lo:400:kworker.0 Request processed in 1520us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851294.151345:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788851294.151392:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019826560:0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.151404:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019827072:0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.151415:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019827584:0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.151425:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019826688:0@lo:400:kworker.0 00000100:00100000:1.0:1788851294.151437:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019827200:0@lo:400:kworker.0 00010000:00080000:1.0:1788851294.151450:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87a38000 x1875746019827712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851294.151460:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019827712:0@lo:400:kworker.0 00000100:00100000:0.0F:1788851294.649352:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788851294.649391:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019827840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788851294.649471:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851294.649531:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019827840 00000100:00100000:0.0:1788851294.649540:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019827840 00000100:00100000:0.0:1788851294.649593:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788851294.649603:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019827840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788851294.649635:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788851294.649697:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019827840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851294.649705:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788851294.649751:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019827840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851294.815208:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851294.815252:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000874240 00000100:00100000:3.0:1788851294.815263:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000874240 00000100:00100000:3.0:1788851294.815329:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:3.0:1788851294.817344:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+13:15613:x1875746000874240:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788851294.817534:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+13:15613:x1875746000874240:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 2195us (2336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851294.817544:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00080000:0.0:1788851294.820622:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851294.831091:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851294.831204:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000874368 00000100:00100000:2.0:1788851294.831216:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000874368 00000100:00100000:2.0:1788851294.831278:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00100000:2.0:1788851294.831288:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:15613:x1875746000874368:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788851294.831392:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:15613:x1875746000874368:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851294.831401:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 66 00000100:00080000:0.0:1788851294.831579:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851294.840255:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851294.840292:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000874624 00000100:00100000:0.0:1788851294.840302:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000874624 00000100:00100000:0.0:1788851294.840355:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1788851294.840366:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+13:15613:x1875746000874624:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788851294.840595:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+14:15613:x1875746000874624:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 230us (350us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788851294.840603:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00010000:00010000:1.0:1788851295.028746:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851295.156379:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019827968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851295.156460:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851295.156645:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019827968 00000100:00100000:3.0:1788851295.156654:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019827968 00000100:00100000:3.0:1788851295.156716:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788851295.156726:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019827968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851295.156764:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788851295.156845:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019827968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851295.156865:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788851295.156913:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019827968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788851295.157333:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019828096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851295.157366:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851295.157483:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019828096 00000100:00100000:3.0:1788851295.157488:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019828096 00000100:00100000:3.0:1788851295.157523:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788851295.157530:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019828096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851295.157563:0:18246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788851295.157607:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019828096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851295.157613:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788851295.157742:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019828096:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788851296.052433:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851296.692585:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851296.694798:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019828224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851296.694881:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851296.695361:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019828224 00000100:00100000:3.0:1788851296.695370:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019828224 00000100:00100000:3.0:1788851296.695442:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788851296.695455:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019828224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851296.695486:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788851296.695567:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019828224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851296.695575:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788851296.695599:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851296.695679:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019828224:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788851296.973980:0:20585:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 03:08:15 (1788851295) 00000100:00100000:2.0:1788851297.020319:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851297.020368:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851297.020402:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851297.020443:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000874880 00000100:00100000:2.0:1788851297.020453:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000874880 00000100:00100000:2.0:1788851297.020520:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000875008 00000100:00100000:2.0:1788851297.020531:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000875008 00000100:00100000:2.0:1788851297.020560:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:2.0:1788851297.020570:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+14:2408:x1875746000874880:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851297.020654:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+14:2408:x1875746000874880:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 85us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851297.020662:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:2.0:1788851297.020679:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:2.0:1788851297.020686:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000875008:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851297.020713:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000875008:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851297.020719:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00080000:2.0:1788851297.020742:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851297.020746:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851297.021072:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000874752 00000100:00100000:1.0:1788851297.021088:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000874752 00000100:00100000:1.0:1788851297.021139:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 170 00000100:00100000:1.0:1788851297.021149:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:2408:x1875746000874752:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851297.021212:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:2408:x1875746000874752:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 66us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851297.021221:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 170 00000100:00100000:2.0:1788851297.027471:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851297.027519:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851297.027552:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851297.027573:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000875136 00000100:00100000:2.0:1788851297.027591:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851297.027593:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000875136 00000100:00100000:2.0:1788851297.027617:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851297.027643:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851297.027671:0:19145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000875648 00000100:00100000:2.0:1788851297.027681:0:19145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000875648 00000100:00100000:2.0:1788851297.027729:0:19145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000875776 00000100:00100000:2.0:1788851297.027732:0:19145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000875776 00000100:00100000:2.0:1788851297.027743:0:19145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000875264 00000100:00100000:2.0:1788851297.027745:0:19145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000875264 00000100:00100000:2.0:1788851297.027763:0:19145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:2.0:1788851297.027772:0:19145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000875264:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851297.027876:0:19145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2408:x1875746000875264:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851297.027885:0:19145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:2.0:1788851297.027905:0:19145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:3.0:1788851297.028754:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:3.0:1788851297.028776:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2406:x1875746000875776:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:3.0:1788851297.028822:0:18719:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206f9b 00000100:00080000:3.0:1788851297.028865:0:18719:0:(import.c:65:import_set_state_nolock()) ffff892d881f7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788851297.028940:0:18719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788851297.029079:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000875520 00000100:00100000:0.0:1788851297.029095:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000875520 00000100:00100000:0.0:1788851297.029152:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000875392 00000100:00100000:0.0:1788851297.029155:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000875392 00000100:00100000:0.0:1788851297.029188:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:0.0:1788851297.029199:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000875520:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851297.030577:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+2:2406:x1875746000875776:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 1797us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851297.030595:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:0.0:1788851297.030922:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2408:x1875746000875520:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 1521us (3100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851297.030937:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:0.0:1788851297.030985:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:0.0:1788851297.031001:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2408:x1875746000875392:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851297.031177:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2408:x1875746000875392:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 183us (3532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851297.031185:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00080000:1.0:1788851297.031343:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851297.031352:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851297.031358:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851297.031364:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851297.032157:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:2.0:1788851297.032432:0:19145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2406:x1875746000875648:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:2.0:1788851297.032470:0:19145:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206f94 00000100:00080000:2.0:1788851297.032485:0:19145:0:(import.c:65:import_set_state_nolock()) ffff892d81a60800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788851297.032578:0:19145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788851297.032912:0:19145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:328c7902-b357-4550-8a0f-a89bc9b6ec05+2:2406:x1875746000875648:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 4997us (5391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851297.032924:0:19145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:3.0:1788851297.038973:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2406:x1875746000875136:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:3.0:1788851297.039153:0:18719:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206f55 00000100:00080000:3.0:1788851297.039175:0:18719:0:(import.c:65:import_set_state_nolock()) ffff892d81a64000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788851297.039366:0:18719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788851297.039766:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+2:2406:x1875746000875136:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 7593us (12303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851297.039781:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00010000:00010000:3.0:1788851297.039890:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851297.039899:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851297.078560:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851298.100419:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788851298.612287:0:17246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788851298.612307:0:17246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788851298.612345:0:17246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788851298.612352:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788851299.125330:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851299.252350:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851299.252378:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019828352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851299.252453:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851299.252718:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019828352 00000100:00100000:2.0:1788851299.252726:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019828352 00000100:00100000:2.0:1788851299.252865:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788851299.252876:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019828352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851299.252908:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788851299.253093:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019828352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 219us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851299.253100:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788851299.253186:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019828352:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788851299.253248:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851299.253823:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019828480:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.253863:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851299.253890:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019828992:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.253916:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851299.253936:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019829504:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.253956:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851299.253973:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788851299.253989:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019828864:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.254030:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851299.254049:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8826a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019829376:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.254070:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851299.254102:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019828480 00000100:00100000:1.0:1788851299.254107:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019828480 00000100:00100000:1.0:1788851299.254155:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788851299.254162:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:3650:x1875746019828480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.254202:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+24:3650:x1875746019828480:12345-0@lo:400:kworker.0 Request processed in 40us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851299.254209:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788851299.254237:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019828992 00000100:00100000:1.0:1788851299.254241:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019828992 00000100:00100000:1.0:1788851299.254267:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019829504 00000100:00100000:1.0:1788851299.254270:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019829504 00000100:00100000:1.0:1788851299.254308:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019829376 00000100:00100000:1.0:1788851299.254312:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019829376 00000100:00100000:1.0:1788851299.254325:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788851299.254331:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019828992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.254365:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019828992:12345-0@lo:400:kworker.0 Request processed in 33us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851299.254371:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788851299.254385:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788851299.254392:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019829504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.254419:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019829504:12345-0@lo:400:kworker.0 Request processed in 28us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851299.254424:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788851299.254436:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788851299.254441:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019829376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.254464:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019829376:12345-0@lo:400:kworker.0 Request processed in 23us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851299.254469:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788851299.254490:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019828864 00000100:00100000:1.0:1788851299.254499:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019828864 00000100:00100000:1.0:1788851299.254713:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788851299.254721:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019828864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851299.254869:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019828608:0@lo:400:kworker.0 00000100:00100000:0.0:1788851299.254903:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851299.254924:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019829120:0@lo:400:kworker.0 00000100:00100000:0.0:1788851299.254945:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851299.254964:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019829632:0@lo:400:kworker.0 00000100:00100000:0.0:1788851299.254995:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851299.255030:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788851299.255037:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019828736:0@lo:400:kworker.0 00000100:00100000:0.0:1788851299.255068:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851299.255084:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019829248:0@lo:400:kworker.0 00000100:00100000:0.0:1788851299.255102:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851299.255118:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019829760:0@lo:400:kworker.0 00000100:00100000:0.0:1788851299.255137:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851299.255162:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019829632 00000100:00100000:0.0:1788851299.255166:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019829632 00000100:00100000:0.0:1788851299.255188:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019829760 00000100:00100000:0.0:1788851299.255191:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019829760 00000100:00100000:0.0:1788851299.255207:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788851299.255213:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019829632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851299.255249:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019829632:12345-0@lo:400:kworker.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851299.255256:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788851299.255267:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788851299.255273:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019829760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851299.255298:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019829760:12345-0@lo:400:kworker.0 Request processed in 26us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851299.255303:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788851299.255320:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019828736 00000100:00100000:0.0:1788851299.255323:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019828736 00000100:00100000:0.0:1788851299.255339:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019829248 00000100:00100000:0.0:1788851299.255342:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019829248 00000100:00100000:0.0:1788851299.255354:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788851299.255360:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019828736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851299.255389:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019828736:12345-0@lo:400:kworker.0 Request processed in 29us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851299.255405:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788851299.255416:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788851299.255422:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019829248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851299.255450:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019829248:12345-0@lo:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851299.255455:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788851299.255471:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019828608 00000100:00100000:0.0:1788851299.255476:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019828608 00000100:00100000:0.0:1788851299.255495:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019829120 00000100:00100000:0.0:1788851299.255498:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019829120 00000100:00100000:0.0:1788851299.255509:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788851299.255514:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019828608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.255644:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019828864:12345-0@lo:400:kworker.0 Request processed in 924us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851299.255651:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788851299.255678:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851299.255682:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851299.255685:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851299.255687:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851299.255714:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019828864:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.255725:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019829376:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.255811:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019828480:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.255823:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019828992:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.255832:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8826bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019829504:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.255856:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851299.255861:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019829888:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.255887:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851299.255918:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019829888 00000100:00100000:1.0:1788851299.255921:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019829888 00000100:00100000:1.0:1788851299.255952:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788851299.255958:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019829888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.256002:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019829888:12345-0@lo:400:kworker.0 Request processed in 45us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851299.256008:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788851299.256049:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788851299.256070:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590ca80 x1875746019829888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851299.256081:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019829888:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.256139:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019828736:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.256150:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019829248:0@lo:400:kworker.0 00000100:00100000:1.0:1788851299.256158:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019829760:0@lo:400:kworker.0 00010000:00080000:1.0:1788851299.256169:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590ea00 x1875746019829632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851299.256177:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019829632:0@lo:400:kworker.0 00000100:00100000:3.0:1788851299.256372:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788851299.256382:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019829120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851299.256425:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019829120:12345-0@lo:400:kworker.0 Request processed in 45us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851299.256431:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788851299.256462:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019829120:0@lo:400:kworker.0 00000100:00100000:3.0:1788851299.256815:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851299.256827:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019830016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851299.256862:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851299.256987:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019830016 00000100:00100000:2.0:1788851299.256993:0:18723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019830016 00000100:00100000:1.0:1788851299.257199:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019828608:12345-0@lo:400:kworker.0 Request processed in 1683us (2294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851299.257207:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788851299.257287:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019828608:0@lo:400:kworker.0 00000100:00100000:2.0:1788851299.257338:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788851299.257347:0:18723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019830016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851299.257369:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788851299.257419:0:18723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019830016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851299.257426:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788851299.257487:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019830016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851299.765536:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019830144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851299.765649:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851299.766241:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019830144 00000100:00100000:1.0:1788851299.766252:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019830144 00000100:00100000:1.0:1788851299.766321:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788851299.766331:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019830144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851299.766365:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788851299.766432:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019830144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851299.766440:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788851299.766500:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019830144:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1788851299.774270:0:17192:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:0.0:1788851299.774291:0:17192:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:3.0:1788851299.774345:0:17251:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:3.0:1788851299.774365:0:17251:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:00080000:3.0:1788851300.085704:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788851300.148473:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851300.276663:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019830272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788851300.276788:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851300.276928:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019830272 00000100:00100000:3.0:1788851300.276940:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019830272 00000100:00100000:3.0:1788851300.277039:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788851300.277053:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019830272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851300.277104:0:18246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788851300.277183:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019830272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851300.277193:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788851300.277262:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019830272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851300.277825:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019830400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851300.277932:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851300.278035:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019830400 00000100:00100000:0.0:1788851300.278046:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019830400 00000100:00100000:0.0:1788851300.279169:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788851300.279193:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019830400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788851300.280610:0:17218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788851300.282409:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019830400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3208us (4459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851300.282431:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788851300.282496:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019830400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851300.921100:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851300.921210:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000876032 00000100:00100000:0.0:1788851300.921228:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000876032 00000100:00080000:1.0:1788851300.921337:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851300.921352:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:0.0:1788851300.921388:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+13:16366:x1875746000876032:12345-192.168.204.27@tcp:35:umount.0 00000001:00080000:0.0:1788851300.922434:0:17216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788851300.922551:0:17216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1788851300.922854:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cfece06-2f06-458e-aaf0-aac64f28cf2c+16:16366:x1875746000876032:12345-192.168.204.27@tcp:35:umount.0 Request processed in 1466us (1758us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1788851300.922867:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000020:00080000:0.0:1788851300.922875:0:17216:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788851300.940420:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851300.940547:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851300.945515:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851300.945575:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851300.945707:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000876416 00000100:00100000:0.0:1788851300.945721:0:18721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000876416 00000100:00100000:0.0:1788851300.945815:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:0.0:1788851300.945828:0:18721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2406:x1875746000876416:12345-192.168.204.27@tcp:9:umount.0 00000020:00000080:0.0:1788851300.945886:0:18721:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206f5c 00000100:00080000:0.0:1788851300.945899:0:18721:0:(import.c:65:import_set_state_nolock()) ffff892d81a66000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788851300.945971:0:18721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788851300.946206:0:18721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5cfece06-2f06-458e-aaf0-aac64f28cf2c+2:2406:x1875746000876416:12345-192.168.204.27@tcp:9:umount.0 Request processed in 381us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851300.946216:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00010000:00010000:0.0:1788851300.946248:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788851300.946324:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851300.946809:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000876288 00000100:00100000:1.0:1788851300.946819:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000876288 00000100:00100000:1.0:1788851300.946888:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000876160 00000100:00100000:1.0:1788851300.946893:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000876160 00000100:00100000:1.0:1788851300.946934:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1788851300.946956:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+14:2408:x1875746000876288:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851300.946972:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851300.947004:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eebbc00/0x3e0030720b206f39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e3a expref: 14 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851300.947054:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851300.947101:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+13:2408:x1875746000876288:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 159us (6700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851300.947109:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1788851300.947135:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:1.0:1788851300.947142:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:2407:x1875746000876160:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851300.947150:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851300.947161:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eebae00/0x3e0030720b206f32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e09 expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851300.947173:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851300.947191:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:2407:x1875746000876160:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 50us (6645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851300.947221:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:1.0:1788851300.950214:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000876544 00000100:00100000:1.0:1788851300.950236:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000876544 00000100:00100000:1.0:1788851300.950338:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:1.0:1788851300.950352:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:2408:x1875746000876544:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851300.950375:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851300.950401:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433d000/0x3e0030720b206fbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ef0 expref: 11 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851300.950423:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851300.950511:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:2408:x1875746000876544:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 162us (4947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851300.950518:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1788851300.969726:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851300.969984:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000877440 00000100:00100000:1.0:1788851300.970005:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000877440 00000100:00100000:0.0:1788851300.970391:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:0.0:1788851300.970410:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+16:2406:x1875746000877440:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:0.0:1788851300.970483:0:18245:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206f47 00000020:00010000:0.0:1788851300.970512:0:18245:0:(genops.c:1920:obd_stale_export_put()) Put export ffff892d815a8000: total 0 00000100:00080000:0.0:1788851300.970519:0:18245:0:(import.c:65:import_set_state_nolock()) ffff892d815ab000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788851300.970702:0:17201:0:(genops.c:1906:obd_stale_export_get()) Get export ffff892d815a8000: total 0 00010000:00010000:3.0:1788851300.970708:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851300.970800:0:17201:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff892d815a8000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788851300.970862:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892ea55ec600) 00010000:00010000:3.0:1788851300.970868:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851300.970895:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94a00/0x3e0030720b20702e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38efe expref: 15 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851300.970954:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ec1d49500) 00010000:00010000:3.0:1788851300.970958:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851300.970963:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bd200/0x3e0030720b20706d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f0c expref: 14 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851300.971100:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff892ec1d49e00) 00010000:00010000:3.0:1788851300.971110:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851300.971115:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa000/0x3e0030720b2071fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f8a expref: 13 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851300.971138:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851300.971141:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851300.971145:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d400/0x3e0030720b207250 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38fa6 expref: 12 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851300.971165:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff892e8af96100) 00010000:00010000:3.0:1788851300.971168:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851300.971173:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e827ea800/0x3e0030720b207012 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ef7 expref: 11 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851300.971197:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff892e8af96600) 00010000:00010000:3.0:1788851300.971200:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788851300.971204:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433da00/0x3e0030720b2070f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f36 expref: 10 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851300.971219:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851300.971229:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851300.971233:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433ca00/0x3e0030720b2071a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f75 expref: 9 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851300.971247:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff892ea55ec700) 00010000:00010000:3.0:1788851300.971263:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851300.971269:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea55bc200/0x3e0030720b207170 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f60 expref: 8 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851300.971284:0:17201:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff892d815a8000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1788851300.971299:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851300.971300:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851300.971302:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788851300.971908:0:18245:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1788851300.972369:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cfece06-2f06-458e-aaf0-aac64f28cf2c+6:2406:x1875746000877440:12345-192.168.204.27@tcp:39:umount.0 Request processed in 1956us (2653us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1788851300.972395:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 67 00000100:00100000:0.0:1788851300.983618:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851300.983742:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000877568 00000100:00100000:1.0:1788851300.983757:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000877568 00000100:00100000:1.0:1788851300.983848:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 68 00000100:00100000:1.0:1788851300.983861:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+5:2406:x1875746000877568:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:1.0:1788851300.983919:0:17212:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206f4e 00000100:00080000:1.0:1788851300.983942:0:17212:0:(import.c:65:import_set_state_nolock()) ffff892d815ae800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788851300.984000:0:17212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788851300.984401:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cfece06-2f06-458e-aaf0-aac64f28cf2c+3:2406:x1875746000877568:12345-192.168.204.27@tcp:39:umount.0 Request processed in 541us (797us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788851300.984411:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 68 00010000:00010000:2.0:1788851300.984869:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788851300.986007:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788851301.172420:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851301.813982:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019830528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851301.814130:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851301.817173:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019830528 00000100:00100000:3.0:1788851301.817197:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019830528 00000100:00100000:3.0:1788851301.817317:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788851301.817332:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019830528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851301.817376:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788851301.817492:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019830528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (3362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851301.817500:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788851301.817587:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019830528:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788851301.817645:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851302.133330:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851302.133373:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851302.133504:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000877824 00000100:00100000:0.0:1788851302.133515:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000877824 00000100:00100000:0.0:1788851302.133593:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:0.0:1788851302.133605:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2407:x1875746000877824:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:3.0:1788851302.133833:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851302.133995:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2407:x1875746000877824:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 391us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851302.134004:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:2.0:1788851302.136106:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000877696 00000100:00100000:2.0:1788851302.136121:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000877696 00000100:00100000:2.0:1788851302.136188:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 172 00000100:00100000:2.0:1788851302.136200:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:2407:x1875746000877696:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851302.136703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851302.140578:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000877952 00000100:00100000:0.0:1788851302.140595:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000877952 00000100:00100000:0.0:1788851302.140713:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:0.0:1788851302.140724:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2407:x1875746000877952:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851302.140817:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2407:x1875746000877952:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 95us (4117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851302.140825:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:2.0:1788851302.140860:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:2407:x1875746000877696:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 4660us (7483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851302.140871:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 172 00000100:00080000:1.0:1788851302.141444:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788851302.198719:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851302.730329:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851302.730371:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851302.730402:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851302.730473:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000878080 00000100:00100000:1.0:1788851302.730484:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000878080 00000100:00100000:1.0:1788851302.730555:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000878336 00000100:00100000:1.0:1788851302.730559:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000878336 00000100:00100000:1.0:1788851302.730572:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000878208 00000100:00100000:1.0:1788851302.730575:0:17198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000878208 00000100:00100000:1.0:1788851302.730592:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:1.0:1788851302.730602:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+12:2409:x1875746000878080:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851302.730619:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851302.730639:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff95e00/0x3e0030720b206f71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e79 expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851302.730658:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851302.730712:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+11:2409:x1875746000878080:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 111us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851302.730719:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:1.0:1788851302.730737:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1788851302.730744:0:17198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+10:2409:x1875746000878336:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851302.730751:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851302.730762:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433dc00/0x3e0030720b206fb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ee9 expref: 10 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851302.730770:0:18367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00010000:00010000:1.0:1788851302.730775:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851302.730783:0:18367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+9:2409:x1875746000878208:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851302.730794:0:18367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788851302.730796:0:17198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+9:2409:x1875746000878336:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 52us (423us total) trans 0 rc 0/0 00010000:00010000:3.0:1788851302.730806:0:18367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff95000/0x3e0030720b206f78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38eaa expref: 9 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851302.730824:0:18367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851302.730826:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1788851302.730868:0:18367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+7:2409:x1875746000878208:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 88us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851302.730876:0:18367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1788851302.743824:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851302.744053:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000878592 00000100:00100000:0.0:1788851302.744064:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000878592 00000100:00100000:0.0:1788851302.744144:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:0.0:1788851302.744155:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:328c7902-b357-4550-8a0f-a89bc9b6ec05+6:2406:x1875746000878592:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:0.0:1788851302.744195:0:18245:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206f86 00000020:00010000:0.0:1788851302.744204:0:18245:0:(genops.c:1920:obd_stale_export_put()) Put export ffff892d81a1e800: total 0 00000100:00080000:0.0:1788851302.744209:0:18245:0:(import.c:65:import_set_state_nolock()) ffff892d81a1f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788851302.744238:0:18245:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:3.0:1788851302.744260:0:17201:0:(genops.c:1906:obd_stale_export_get()) Get export ffff892d81a1e800: total 0 00010000:00010000:3.0:1788851302.744317:0:17201:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff892d81a1e800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788851302.744360:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892ec1d49500) 00010000:00010000:3.0:1788851302.744364:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851302.744371:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ea433d200/0x3e0030720b20707b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38f13 expref: 5 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851302.744397:0:17201:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff892d81a1e800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788851302.744411:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851302.744412:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:328c7902-b357-4550-8a0f-a89bc9b6ec05+3:2406:x1875746000878592:12345-192.168.204.27@tcp:39:umount.0 Request processed in 256us (594us total) trans 8589934628 rc 0/0 00010000:00010000:3.0:1788851302.744414:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851302.744418:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851302.744426:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 69 00000100:00100000:1.0:1788851302.759676:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851302.759772:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000878720 00000100:00100000:3.0:1788851302.759783:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000878720 00000100:00100000:3.0:1788851302.759855:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 70 00000100:00100000:3.0:1788851302.759867:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+5:2406:x1875746000878720:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:3.0:1788851302.759936:0:17214:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206f8d 00000100:00080000:3.0:1788851302.759950:0:17214:0:(import.c:65:import_set_state_nolock()) ffff892eb699a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788851302.759981:0:17214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788851302.760203:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:328c7902-b357-4550-8a0f-a89bc9b6ec05+3:2406:x1875746000878720:12345-192.168.204.27@tcp:39:umount.0 Request processed in 337us (536us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788851302.760212:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 70 00010000:00010000:2.0:1788851302.760621:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851302.794415:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851302.794643:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000878976 00000100:00100000:1.0:1788851302.794656:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000878976 00000100:00100000:1.0:1788851302.794731:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 173 00000100:00100000:1.0:1788851302.794743:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+7:2406:x1875746000878976:12345-192.168.204.27@tcp:251:umount.0 00000020:00000080:1.0:1788851302.794799:0:17207:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206f24 00000020:00010000:1.0:1788851302.794809:0:17207:0:(genops.c:1920:obd_stale_export_put()) Put export ffff892d81a65000: total 0 00000100:00080000:1.0:1788851302.794814:0:17207:0:(import.c:65:import_set_state_nolock()) ffff892d81a63800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788851302.795099:0:17201:0:(genops.c:1906:obd_stale_export_get()) Get export ffff892d81a65000: total 0 00010000:00010000:3.0:1788851302.795104:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851302.795163:0:17201:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff892d81a65000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788851302.795211:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eebb000/0x3e0030720b206f2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38e02 expref: 3 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851302.795230:0:17201:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff892d81a65000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788851302.795241:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851302.795243:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851302.795245:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851302.795488:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d11739f-0de9-4ad9-a829-6d1cc8cc568e+1:2406:x1875746000878976:12345-192.168.204.27@tcp:251:umount.0 Request processed in 747us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851302.795497:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 173 00000020:00000080:1.0:1788851302.795509:0:17207:0:(genops.c:885:class_export_put()) final put ffff892d81a65000/2d11739f-0de9-4ad9-a829-6d1cc8cc568e 00000020:00000080:3.0:1788851302.796492:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d81a65000/2d11739f-0de9-4ad9-a829-6d1cc8cc568e for MGS 00000020:00000080:3.0:1788851302.796536:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d81a63800 for MGS 00000001:00100000:2.0:1788851302.839533:0:19531:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5cfece06-2f06-458e-aaf0-aac64f28cf2c 00000020:00000080:2.0:1788851302.839543:0:19531:0:(genops.c:885:class_export_put()) final put ffff892d81a63000/5cfece06-2f06-458e-aaf0-aac64f28cf2c 00000001:00100000:2.0:1788851302.839624:0:19531:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 328c7902-b357-4550-8a0f-a89bc9b6ec05 00000020:00000080:2.0:1788851302.839627:0:19531:0:(genops.c:885:class_export_put()) final put ffff892e83e28800/328c7902-b357-4550-8a0f-a89bc9b6ec05 00000020:00000080:0.0:1788851302.839717:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d81a63000/5cfece06-2f06-458e-aaf0-aac64f28cf2c for lustre-OST0001 00000020:00000080:0.0:1788851302.839772:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d81a66000 for lustre-OST0001 00000001:00100000:0.0:1788851302.840205:0:18715:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5cfece06-2f06-458e-aaf0-aac64f28cf2c 00000020:00000080:0.0:1788851302.840210:0:18715:0:(genops.c:885:class_export_put()) final put ffff892d81a66800/5cfece06-2f06-458e-aaf0-aac64f28cf2c 00000001:00100000:0.0:1788851302.840261:0:18715:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 328c7902-b357-4550-8a0f-a89bc9b6ec05 00000020:00000080:0.0:1788851302.840264:0:18715:0:(genops.c:885:class_export_put()) final put ffff892d81a60000/328c7902-b357-4550-8a0f-a89bc9b6ec05 00000020:00000080:3.0:1788851302.840410:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d81a66800/5cfece06-2f06-458e-aaf0-aac64f28cf2c for lustre-OST0000 00000020:00000080:3.0:1788851302.840528:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d81a60000/328c7902-b357-4550-8a0f-a89bc9b6ec05 for lustre-OST0000 00000020:00000080:3.0:1788851302.840623:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e28800/328c7902-b357-4550-8a0f-a89bc9b6ec05 for lustre-OST0001 00000020:00000080:3.0:1788851302.840718:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d81a64000 for lustre-OST0000 00000020:00000080:3.0:1788851302.840725:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d81a60800 for lustre-OST0000 00000020:00000080:3.0:1788851302.840728:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d881f7800 for lustre-OST0001 00010000:00010000:2.0:1788851303.220642:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851304.244221:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851304.373747:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019830656:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.373835:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.373888:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019831168:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.373915:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.373935:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019831680:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.373955:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.373971:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019832192:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.373990:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.374038:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788851304.374045:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019830784:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.374069:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.374083:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019831296:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.374101:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.374117:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019831808:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.374135:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.374160:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019830912:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.374193:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.374212:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019831424:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.374230:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.374242:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019831936:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.374259:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.374270:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788851304.374275:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019831040:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.374291:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.374304:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019831552:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.374321:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.374334:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019832064:0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.374351:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.374375:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019831168 00000100:00100000:0.0:1788851304.374383:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019831168 00000100:00100000:0.0:1788851304.374425:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019831680 00000100:00100000:0.0:1788851304.374428:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019831680 00000100:00100000:0.0:1788851304.374439:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019832192 00000100:00100000:0.0:1788851304.374442:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019832192 00000100:00100000:0.0:1788851304.374611:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019831808 00000100:00100000:0.0:1788851304.374615:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019831808 00000100:00100000:0.0:1788851304.374629:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019831936 00000100:00100000:0.0:1788851304.374632:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019831936 00000100:00100000:0.0:1788851304.374643:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019832064 00000100:00100000:0.0:1788851304.374646:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019832064 00000100:00100000:0.0:1788851304.374662:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788851304.374672:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019831168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.374743:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019831168:12345-0@lo:400:kworker.0 Request processed in 71us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851304.374762:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788851304.374784:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788851304.374790:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019831680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.374890:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019831680:12345-0@lo:400:kworker.0 Request processed in 90us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851304.374897:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788851304.374912:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788851304.374918:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019832192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.374948:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019832192:12345-0@lo:400:kworker.0 Request processed in 30us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851304.374954:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788851304.374967:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788851304.374973:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019831808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.375000:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019831808:12345-0@lo:400:kworker.0 Request processed in 27us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851304.375005:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788851304.375041:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788851304.375048:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019831936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.375082:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019831936:12345-0@lo:400:kworker.0 Request processed in 36us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851304.375088:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788851304.375099:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788851304.375105:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019832064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.375130:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875746019832064:12345-0@lo:400:kworker.0 Request processed in 26us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851304.375143:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788851304.375172:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019830784 00000100:00100000:0.0:1788851304.375177:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019830784 00000100:00100000:0.0:1788851304.375202:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019831296 00000100:00100000:0.0:1788851304.375206:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019831296 00000100:00100000:0.0:1788851304.375218:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788851304.375223:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019830784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.375257:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019830784:12345-0@lo:400:kworker.0 Request processed in 33us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851304.375263:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788851304.375274:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788851304.375280:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019831296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.375319:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019831296:12345-0@lo:400:kworker.0 Request processed in 39us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851304.375326:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788851304.375348:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019830912 00000100:00100000:0.0:1788851304.375351:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019830912 00000100:00100000:0.0:1788851304.375370:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019831424 00000100:00100000:0.0:1788851304.375373:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019831424 00000100:00100000:0.0:1788851304.375382:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019831040 00000100:00100000:0.0:1788851304.375385:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019831040 00000100:00100000:0.0:1788851304.375395:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019831552 00000100:00100000:0.0:1788851304.375397:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019831552 00000100:00100000:0.0:1788851304.375409:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788851304.375414:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019830912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851304.375442:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019830912:12345-0@lo:400:kworker.0 Request processed in 28us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851304.375615:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019830656 00000100:00100000:2.0:1788851304.375619:0:17205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019830656 00000100:00100000:2.0:1788851304.375650:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788851304.375657:0:17205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:3647:x1875746019830656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.375692:0:17205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8a82bd-f416-4736-bb65-b562856c988b+24:3647:x1875746019830656:12345-0@lo:400:kworker.0 Request processed in 36us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851304.375699:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788851304.375752:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788851304.375874:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851304.375888:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851304.375891:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851304.375893:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851304.379343:0:19145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788851304.379367:0:19145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019831424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.379467:0:19145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019831424:12345-0@lo:400:kworker.0 Request processed in 110us (5235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851304.379476:0:19145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788851304.379505:0:19145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788851304.379512:0:19145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019831040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.379541:0:19145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019831040:12345-0@lo:400:kworker.0 Request processed in 30us (5249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851304.379547:0:19145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788851304.379558:0:19145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788851304.379566:0:19145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019831552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.379611:0:19145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019831552:12345-0@lo:400:kworker.0 Request processed in 47us (5288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851304.379625:0:19145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788851304.379697:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019832320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851304.379734:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851304.379775:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019832320 00000100:00100000:2.0:1788851304.379782:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019832320 00000100:00100000:2.0:1788851304.379828:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788851304.379835:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019832320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851304.379855:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788851304.379901:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019832320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851304.379907:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788851304.379929:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788851304.379939:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019832448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851304.379963:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851304.380036:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019832320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851304.380056:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019832448 00000100:00100000:2.0:1788851304.380059:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019832448 00000100:00100000:2.0:1788851304.380077:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788851304.380083:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019832448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851304.380092:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788851304.380119:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019832448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851304.380125:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788851304.380149:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019832448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851304.380555:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019831040:0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.380577:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019831552:0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.380589:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875746019832064:0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.380602:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019830912:0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.380612:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019831424:0@lo:400:kworker.0 00010000:00080000:2.0:1788851304.380624:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e85697480 x1875746019831936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851304.380635:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019831936:0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.380671:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019830784:0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.380683:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019831296:0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.380693:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019831808:0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.380702:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019830656:0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.380712:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019831168:0@lo:400:kworker.0 00000100:00100000:2.0:1788851304.380722:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019831680:0@lo:400:kworker.0 00010000:00080000:2.0:1788851304.380733:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e85695180 x1875746019832192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851304.380742:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019832192:0@lo:400:kworker.0 00000020:01000004:2.0:1788851304.421079:0:20780:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788851304.450006:0:20780:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788851304.450167:0:20780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.450203:0:20780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.450211:0:20780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.450218:0:20780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.450281:0:20780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788851304.450288:0:20780:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788851304.450316:0:20780:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788851304.450321:0:20780:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788851304.450327:0:20780:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788851304.450353:0:20780:0:(import.c:65:import_set_state_nolock()) ffff892ea5569800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788851304.450418:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019832576:0@lo:39:umount.0 00000100:00100000:3.0:1788851304.450558:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851304.450661:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019832576 00000100:00100000:1.0:1788851304.450668:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019832576 00000100:00100000:1.0:1788851304.450720:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788851304.450729:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875746019832576:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788851304.450754:0:18245:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206b18 00000100:00080000:1.0:1788851304.450763:0:18245:0:(import.c:65:import_set_state_nolock()) ffff892ea556f000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788851304.450819:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851304.450828:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.450837:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031a00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851304.450841:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.450851:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851304.450860:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851304.450866:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851304.450870:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788851304.450872:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788851304.450908:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.450915:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851304.450944:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.450951:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80031a00/0x3e0030720b206ae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206aee expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.450964:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851304.450966:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851304.450968:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851304.451090:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019832704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851304.451125:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.451281:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019832704 00000100:00100000:0.0:1788851304.451294:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019832704 00000100:00100000:0.0:1788851304.451336:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851304.451344:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a8a82bd-f416-4736-bb65-b562856c988b+24:3650:x1875746019832704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851304.451354:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851304.451368:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80030e00/0x3e0030720b206aee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206ae7 expref: 24 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.451381:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851304.451423:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a8a82bd-f416-4736-bb65-b562856c988b+23:3650:x1875746019832704:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851304.451431:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788851304.451575:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019832704:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851304.451779:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851304.451818:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1875746019832576:12345-0@lo:39:umount.0 Request processed in 1081us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851304.451826:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1788851304.451838:0:18245:0:(genops.c:885:class_export_put()) final put ffff892ea556b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788851304.451980:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea556b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788851304.452058:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea556f000 for lustre-MDT0000 00000100:00080000:0.0:1788851304.452194:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5569800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788851304.452241:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019832576:0@lo:39:umount.0 00000100:00080000:2.0:1788851304.452273:0:20780:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788851304.452276:0:20780:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788851304.452281:0:20780:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788851304.454194:0:20780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.454214:0:20780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.454222:0:20780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.454244:0:20780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.454305:0:20780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851304.454312:0:20780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.454320:0:20780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.454326:0:20780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.454333:0:20780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.454362:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851304.454370:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.454377:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030800 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851304.454382:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.454391:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851304.454399:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851304.454406:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851304.454408:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788851304.454444:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.454521:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788851304.454586:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019832832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851304.454651:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788851304.454726:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.454734:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80030800/0x3e0030720b206a38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206a3f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.454750:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851304.454753:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.454759:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bce00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851304.454762:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.454769:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851304.454775:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851304.454780:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851304.454782:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1788851304.454795:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.454801:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851304.454807:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851304.454938:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851304.454945:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019832960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851304.454969:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788851304.455005:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851304.455007:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851304.455009:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851304.455093:0:20780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788851304.455099:0:20780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea55bce00/0x3e0030720b206e44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206e4b expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851304.455109:0:20780:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788851304.455118:0:20780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.455125:0:20780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.455131:0:20780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.455144:0:20780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.455154:0:20780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851304.455160:0:20780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.455167:0:20780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.455172:0:20780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.455178:0:20780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.455184:0:20780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788851304.455188:0:20780:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788851304.455191:0:20780:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788851304.455224:0:20780:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788851304.455229:0:20780:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788851304.455233:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851304.455239:0:20780:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1788851304.455244:0:20780:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff892eb6997800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788851304.455250:0:20780:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff892d81b6b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788851304.455255:0:20780:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff892d85c55000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788851304.455259:0:20780:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff892e83e2a000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788851304.455275:0:20780:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff892d81a1e800 328c7902-b357-4550-8a0f-a89bc9b6ec05 192.168.204.27@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1788851304.455280:0:20780:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff892d815a8000 5cfece06-2f06-458e-aaf0-aac64f28cf2c 192.168.204.27@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:2.0:1788851304.455284:0:20780:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff892d874a19c0) has exports, disconnecting them 00000020:00080000:2.0:1788851304.455289:0:20780:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff892eb6997800), last request at 1788851304 00000020:00000080:2.0:1788851304.455296:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206e13 00000100:00080000:2.0:1788851304.455314:0:20780:0:(import.c:65:import_set_state_nolock()) ffff892eb6993800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788851304.455359:0:20780:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892eb6997800): rc 0 00000020:00000080:2.0:1788851304.455361:0:20780:0:(genops.c:885:class_export_put()) final put ffff892eb6997800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788851304.455372:0:20780:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff892d81b6b800), last request at 1788851304 00000020:00000080:2.0:1788851304.455375:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206cbc 00000100:00080000:2.0:1788851304.455380:0:20780:0:(import.c:65:import_set_state_nolock()) ffff892d81b6f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788851304.455386:0:20780:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d81b6b800): rc 0 00000020:00000080:2.0:1788851304.455388:0:20780:0:(genops.c:885:class_export_put()) final put ffff892d81b6b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788851304.455391:0:20780:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff892d85c55000), last request at 1788851228 00000020:00000080:2.0:1788851304.455393:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206c06 00000100:00080000:2.0:1788851304.455396:0:20780:0:(import.c:65:import_set_state_nolock()) ffff892d85c55800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788851304.455401:0:20780:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d85c55000): rc 0 00000020:00000080:2.0:1788851304.455403:0:20780:0:(genops.c:885:class_export_put()) final put ffff892d85c55000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788851304.455406:0:20780:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff892e83e2a000), last request at 1788851228 00000020:00000080:2.0:1788851304.455409:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206b9d 00000100:00080000:2.0:1788851304.455412:0:20780:0:(import.c:65:import_set_state_nolock()) ffff892eab221800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788851304.455418:0:20780:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:2.0:1788851304.455505:0:20780:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892e83e2a000): rc 0 00000004:00000080:2.0:1788851304.455511:0:20780:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa9904844fae0 00000100:00080000:2.0:1788851304.455528:0:20780:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788851304.455531:0:20780:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788851304.456549:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851304.456563:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.456575:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95c00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851304.456580:0:17201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.456590:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851304.456599:0:17201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851304.456606:0:17201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788851304.456609:0:17201:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788851304.456613:0:17201:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788851304.456655:0:17201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.456662:0:17201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851304.456684:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.456691:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b206fef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206ff6 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.456722:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851304.456727:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.456732:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851304.456736:0:17201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.456744:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851304.456751:0:17201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851304.456757:0:17201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851304.456760:0:17201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788851304.456761:0:17201:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788851304.456774:0:17201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.456781:0:17201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851304.456787:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.456794:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b206a2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206a31 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851304.456803:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851304.456805:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851304.456824:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851304.456833:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851304.456851:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019833088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851304.456932:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019833216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851304.456957:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788851304.457182:0:20780:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788851304.457204:0:20780:0:(import.c:65:import_set_state_nolock()) ffff892ea576a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:1.0:1788851304.457587:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892eb6997800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788851304.457636:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d81b6b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788851304.457657:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d85c55000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788851304.457677:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892eb6993800 for lustre-MDT0000 00000020:00000080:1.0:1788851304.457683:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d81b6f800 for lustre-MDT0000 00000020:00000080:1.0:1788851304.457686:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d85c55800 for lustre-MDT0000 00000100:00080000:1.0:1788851304.457747:0:20780:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788851304.457751:0:20780:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1788851304.457763:0:20780:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788851304.457977:0:20780:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788851304.457990:0:20780:0:(import.c:65:import_set_state_nolock()) ffff892ea5769000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788851304.457997:0:20780:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788851304.458001:0:20780:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1788851304.458039:0:20780:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788851304.458114:0:20780:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788851304.458123:0:20780:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788851304.458166:0:20780:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff892d874a19c0) has no exports 00000100:00100000:0.0:1788851304.458273:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019833344:0@lo:39:umount.0 00000100:00100000:0.0:1788851304.458324:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.458343:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019833472:0@lo:9:umount.0 00000100:00100000:0.0:1788851304.458387:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.458412:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019833600:0@lo:9:umount.0 00000100:00100000:1.0:1788851304.458532:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019832832 00000100:00100000:1.0:1788851304.458541:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019832832 00000100:00100000:1.0:1788851304.458603:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019832960 00000100:00100000:1.0:1788851304.458608:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019832960 00000100:00100000:1.0:1788851304.458622:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019833216 00000100:00100000:1.0:1788851304.458625:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019833216 00000100:00100000:1.0:1788851304.458639:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788851304.458655:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a8a82bd-f416-4736-bb65-b562856c988b+25:3647:x1875746019832832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851304.458670:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851304.458689:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e8a8b8600/0x3e0030720b206a3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206a38 expref: 25 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851304.458703:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851304.458742:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a8a82bd-f416-4736-bb65-b562856c988b+24:3647:x1875746019832832:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (4091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851304.458750:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788851304.458768:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788851304.458774:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a8a82bd-f416-4736-bb65-b562856c988b+23:3647:x1875746019832960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851304.458781:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851304.458790:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea55bdc00/0x3e0030720b206e4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206e44 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851304.458798:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851304.458904:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a8a82bd-f416-4736-bb65-b562856c988b+22:3647:x1875746019832960:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (3933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851304.458911:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788851304.458929:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788851304.458935:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a8a82bd-f416-4736-bb65-b562856c988b+21:3650:x1875746019833216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851304.458943:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851304.458951:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6c00/0x3e0030720b206a31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206a2a expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851304.458960:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851304.458988:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a8a82bd-f416-4736-bb65-b562856c988b+20:3650:x1875746019833216:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851304.459001:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788851304.459061:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019832960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851304.459071:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:3647:1875746019832832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851304.459125:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.459170:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851304.459198:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019833344 00000100:00100000:0.0:1788851304.459202:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019833344 00000100:00100000:0.0:1788851304.459233:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788851304.459239:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875746019833344:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788851304.459268:0:18246:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206c30 00000100:00080000:0.0:1788851304.459277:0:18246:0:(import.c:65:import_set_state_nolock()) ffff892e88fa6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788851304.459297:0:18246:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788851304.459419:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3646:x1875746019833344:12345-0@lo:39:umount.0 Request processed in 179us (1094us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788851304.459425:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788851304.459445:0:19145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019833472 00000100:00100000:2.0:1788851304.459569:0:18367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019833088 00000100:00100000:2.0:1788851304.459573:0:18367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019833088 00000100:00100000:2.0:1788851304.459600:0:18367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788851304.459607:0:18367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a8a82bd-f416-4736-bb65-b562856c988b+20:3649:x1875746019833088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851304.459615:0:18367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851304.459624:0:18367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827ea200/0x3e0030720b206ff6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206fef expref: 20 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851304.459635:0:18367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851304.459664:0:18367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a8a82bd-f416-4736-bb65-b562856c988b+19:3649:x1875746019833088:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851304.459670:0:18367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788851304.459753:0:19145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019833472 00000100:00100000:0.0:1788851304.459788:0:19145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019833600 00000100:00100000:0.0:1788851304.459791:0:19145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019833600 00000100:00100000:2.0:1788851304.460174:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788851304.460183:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875746019833472:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788851304.460205:0:18719:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206cfb 00000100:00080000:2.0:1788851304.460212:0:18719:0:(import.c:65:import_set_state_nolock()) ffff892eacd5b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788851304.460248:0:18719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788851304.460346:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3646:x1875746019833472:12345-0@lo:9:umount.0 Request processed in 165us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851304.460354:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788851304.460368:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788851304.460374:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875746019833600:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788851304.460385:0:18719:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206e52 00000100:00080000:2.0:1788851304.460389:0:18719:0:(import.c:65:import_set_state_nolock()) ffff892d815aa800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788851304.460404:0:18719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00010000:00010000:0.0:1788851304.460559:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788851304.460601:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea576a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788851304.460610:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019833344:0@lo:39:umount.0 00000100:00080000:0.0:1788851304.460622:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5769000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788851304.460634:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788851304.460636:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788851304.460638:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019833472:0@lo:9:umount.0 00000100:00100000:0.0:1788851304.460666:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a8a82bd-f416-4736-bb65-b562856c988b:3649:1875746019833088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851304.460685:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851304.460708:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019833216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851304.460785:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3646:x1875746019833600:12345-0@lo:9:umount.0 Request processed in 411us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851304.460798:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788851304.460992:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e88540000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788851304.461070:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788851304.461645:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788851304.461650:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019833600:0@lo:9:umount.0 00000020:00080000:2.0:1788851304.465434:0:20780:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff892d874a19c0) has no exports 00000020:00000080:2.0:1788851304.518344:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206a85 00000020:00000080:2.0:1788851304.518364:0:20780:0:(genops.c:885:class_export_put()) final put ffff892ea576e800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788851304.518446:0:20780:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788851304.518518:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea576e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788851304.519074:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851304.519087:0:20780:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788851304.519092:0:20780:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff892d87ac19c0) has no exports 00000020:00000080:3.0:1788851304.520856:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206a7e 00000020:00000080:3.0:1788851304.520869:0:20780:0:(genops.c:885:class_export_put()) final put ffff892ea435d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788851304.520970:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea435d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788851304.521216:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788851304.521229:0:20780:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788851304.521233:0:20780:0:(genops.c:885:class_export_put()) final put ffff892ea42e8800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788851304.521256:0:20780:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea42e8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788851304.521262:0:20780:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:2.0:1788851304.885051:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851304.885094:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019833728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851304.885310:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851304.886046:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019833728 00000100:00100000:3.0:1788851304.886056:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019833728 00000100:00100000:3.0:1788851304.886122:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788851304.886133:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019833728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788851304.886347:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788851304.886413:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019833728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 280us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851304.886420:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788851304.886702:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019833728:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788851305.268247:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851305.396463:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019833856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851305.396540:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851305.396666:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019833856 00000100:00100000:2.0:1788851305.396677:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019833856 00000100:00100000:2.0:1788851305.396743:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788851305.396753:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875746019833856:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788851305.396762:0:17218:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788851305.396822:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875746019833856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (282us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788851305.396829:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:02020000:3.0:1788851305.397132:0:3648:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788851305.403497:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788851305.403506:0:3648:0:(import.c:65:import_set_state_nolock()) ffff892e88fa7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788851305.403511:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788851305.425438:0:3648:0:(import.c:65:import_set_state_nolock()) ffff892e88fa7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851305.425453:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 562 00000100:00080000:3.0:1788851305.425470:0:3648:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff892e88fa7000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851305.425527:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d8839a300 x1875746019833984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788851305.426735:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019833984:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788851305.426835:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851305.427235:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019833984 00000100:00100000:2.0:1788851305.427245:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019833984 00000100:00100000:2.0:1788851305.427300:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788851305.427309:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019833984:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788851305.427332:0:17217:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788851305.437307:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019833984:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 9990us (10463us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851305.437323:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1788851305.438939:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e88fa7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788851305.438954:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788851305.438959:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019833984:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1788851306.293582:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788851306.937968:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788851306.937984:0:17944:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788851306.937990:0:17944:0:(genops.c:885:class_export_put()) final put ffff892ea7c1e000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788851306.940903:0:17192:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788851306.940914:0:17192:0:(genops.c:885:class_export_put()) final put ffff892e83e2a000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788851306.941764:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 328c7902-b357-4550-8a0f-a89bc9b6ec05 00000001:00080000:3.0:1788851306.941774:0:17944:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1788851306.941779:0:17944:0:(genops.c:885:class_export_put()) final put ffff892eb6999800/328c7902-b357-4550-8a0f-a89bc9b6ec05 00000001:00100000:3.0:1788851306.941785:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5cfece06-2f06-458e-aaf0-aac64f28cf2c 00000001:00080000:3.0:1788851306.941816:0:17944:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1788851306.941819:0:17944:0:(genops.c:885:class_export_put()) final put ffff892d815ac000/5cfece06-2f06-458e-aaf0-aac64f28cf2c 00000001:00100000:0.0:1788851306.942329:0:17192:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 328c7902-b357-4550-8a0f-a89bc9b6ec05 00000001:00080000:0.0:1788851306.942337:0:17192:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1788851306.942340:0:17192:0:(genops.c:885:class_export_put()) final put ffff892d81a1e800/328c7902-b357-4550-8a0f-a89bc9b6ec05 00000001:00100000:0.0:1788851306.942347:0:17192:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5cfece06-2f06-458e-aaf0-aac64f28cf2c 00000001:00080000:0.0:1788851306.942350:0:17192:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1788851306.942355:0:17192:0:(genops.c:885:class_export_put()) final put ffff892d815a8000/5cfece06-2f06-458e-aaf0-aac64f28cf2c 00000020:00000080:1.0:1788851306.943638:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea7c1e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788851306.944710:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892eb6999800/328c7902-b357-4550-8a0f-a89bc9b6ec05 for lustre-MDT0001 00000020:00000080:1.0:1788851306.944817:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d815ac000/5cfece06-2f06-458e-aaf0-aac64f28cf2c for lustre-MDT0001 00000020:00000080:1.0:1788851306.944853:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e2a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788851306.944874:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d81a1e800/328c7902-b357-4550-8a0f-a89bc9b6ec05 for lustre-MDT0000 00000020:00000080:1.0:1788851306.944897:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d815a8000/5cfece06-2f06-458e-aaf0-aac64f28cf2c for lustre-MDT0000 00000020:00000080:1.0:1788851306.944919:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892e88fa6800 for lustre-MDT0001 00000020:00000080:1.0:1788851306.944924:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892eb699a800 for lustre-MDT0001 00000020:00000080:1.0:1788851306.944927:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d815ae800 for lustre-MDT0001 00000020:00000080:1.0:1788851306.944931:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892eab221800 for lustre-MDT0000 00000020:00000080:1.0:1788851306.944935:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d81a1f000 for lustre-MDT0000 00000020:00000080:1.0:1788851306.944938:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d815ab000 for lustre-MDT0000 00010000:00010000:0.0:1788851307.316908:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851308.341311:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851309.366209:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788851309.492232:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788851309.492239:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788851309.492243:0:8:0:(import.c:65:import_set_state_nolock()) ffff892e88fa7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851309.492268:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 639 00000100:00080000:2.0:1788851309.492274:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788851309.492287:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff892e88fa7000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851309.492313:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea590d180 x1875746019834240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788851309.492401:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019834368:0@lo:400:kworker.0 00000100:00100000:0.0:1788851309.492401:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019834240:0@lo:38:kworker.0 00000100:00100000:1.0:1788851309.492476:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019834496:0@lo:400:kworker.0 00000100:00100000:3.0:1788851309.492574:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019834624:0@lo:400:kworker.0 00000100:00100000:0.0:1788851309.499141:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851309.499618:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019834240 00000100:00100000:0.0:1788851309.499627:0:18246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019834240 00000100:00100000:0.0:1788851309.499672:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788851309.499680:0:18246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875746019834240:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788851309.499699:0:18246:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788851309.500897:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851309.500949:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019835008:0@lo:400:kworker.0 00000100:00100000:1.0:1788851309.500983:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851309.501040:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019835008 00000100:00100000:1.0:1788851309.501046:0:17214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019835008 00000100:00100000:1.0:1788851309.501081:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788851309.501105:0:17214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875746019835008:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788851309.501114:0:17214:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788851309.501157:0:17214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875746019835008:12345-0@lo:400:kworker.0 Request processed in 52us (172us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788851309.501164:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788851309.501208:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788851309.501213:0:3647:0:(import.c:65:import_set_state_nolock()) ffff892d81a65800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788851309.501217:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788851309.501341:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851309.501371:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019834880:0@lo:400:kworker.0 00000100:00100000:2.0:1788851309.501409:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851309.501429:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788851309.501436:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019834112:0@lo:400:kworker.0 00000100:00100000:2.0:1788851309.501464:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851309.501486:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019834752:0@lo:400:kworker.0 00000100:00100000:2.0:1788851309.501508:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851309.501524:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019835264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851309.501546:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851309.501580:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019834496 00000100:00100000:2.0:1788851309.501585:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019834496 00000100:00100000:2.0:1788851309.501622:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019834368 00000100:00100000:2.0:1788851309.501625:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019834368 00000100:00100000:2.0:1788851309.501644:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788851309.501652:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019834496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851309.501691:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019834496:12345-0@lo:400:kworker.0 Request processed in 41us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851309.501698:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788851309.501710:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788851309.501724:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019834368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851309.501757:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019834368:12345-0@lo:400:kworker.0 Request processed in 34us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851309.501763:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788851309.501790:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019834880 00000100:00100000:2.0:1788851309.501794:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019834880 00000100:00100000:2.0:1788851309.501816:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019834752 00000100:00100000:2.0:1788851309.501819:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019834752 00000100:00100000:2.0:1788851309.501832:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788851309.501838:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019834880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851309.501867:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019834880:12345-0@lo:400:kworker.0 Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851309.501872:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788851309.501884:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788851309.501888:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875746019834752:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788851309.501892:0:17213:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788851309.501912:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875746019834752:12345-0@lo:400:kworker.0 Request processed in 23us (404us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788851309.501918:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788851309.501932:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019834112 00000100:00100000:2.0:1788851309.501935:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019834112 00000100:00100000:2.0:1788851309.501957:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788851309.501963:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+19:3650:x1875746019834112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851309.501996:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8a82bd-f416-4736-bb65-b562856c988b+19:3650:x1875746019834112:12345-0@lo:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851309.502002:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788851309.502046:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019835264 00000100:00100000:2.0:1788851309.502056:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019835264 00000100:00100000:2.0:1788851309.502084:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788851309.502090:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019835264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788851309.502110:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788851309.502140:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019835264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851309.502146:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788851309.502185:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019834112:0@lo:400:kworker.0 00000100:00080000:2.0:1788851309.502195:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788851309.502198:0:3650:0:(import.c:65:import_set_state_nolock()) ffff892d85f3b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788851309.502202:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788851309.502207:0:3650:0:(import.c:65:import_set_state_nolock()) ffff892d85f3b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851309.502210:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 577 00000100:00080000:2.0:1788851309.502218:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff892d85f3b800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851309.502244:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87c36680 x1875746019835392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788851309.502265:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019834752:0@lo:400:kworker.0 00000100:00100000:2.0:1788851309.502283:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019835264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851309.502294:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019834368:0@lo:400:kworker.0 00010000:00080000:2.0:1788851309.502303:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590c700 x1875746019834880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851309.502311:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019834880:0@lo:400:kworker.0 00000100:00080000:2.0:1788851309.502369:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851309.502380:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851309.502383:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851309.502412:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019835392:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788851309.502438:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851309.502462:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019835392 00000100:00100000:2.0:1788851309.502466:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019835392 00000100:00100000:2.0:1788851309.502482:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788851309.502486:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019835392:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788851309.502497:0:17213:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788851309.502525:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019835392:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 38us (87us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851309.502531:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788851309.502554:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85f3b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851309.502558:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851309.502561:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019835392:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788851309.506985:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851309.507061:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019835136:0@lo:400:kworker.0 00000100:00100000:3.0:1788851309.507089:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851309.507134:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019834624 00000100:00100000:3.0:1788851309.507143:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019834624 00000100:00100000:3.0:1788851309.507184:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019835136 00000100:00100000:3.0:1788851309.507187:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019835136 00000100:00100000:3.0:1788851309.507230:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788851309.507239:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019835136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851309.507290:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019835136:12345-0@lo:400:kworker.0 Request processed in 52us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851309.507297:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788851309.507315:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788851309.507319:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875746019834624:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788851309.507325:0:17213:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788851309.507349:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875746019834624:12345-0@lo:400:kworker.0 Request processed in 28us (371us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788851309.507354:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788851309.507376:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788851309.507400:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea590ea00 x1875746019835136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851309.507413:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019835136:0@lo:400:kworker.0 00000100:00080000:3.0:1788851309.507438:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788851309.507456:0:3648:0:(import.c:65:import_set_state_nolock()) ffff892d85c52000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788851309.507459:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788851309.507464:0:3648:0:(import.c:65:import_set_state_nolock()) ffff892d85c52000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851309.507468:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 562 00000100:00080000:3.0:1788851309.507476:0:3648:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff892d85c52000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851309.507501:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d8839a680 x1875746019835520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851309.507522:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019834624:0@lo:400:kworker.0 00000100:00100000:3.0:1788851309.507536:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019835520:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788851309.507561:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851309.507585:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019835520 00000100:00100000:3.0:1788851309.507589:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019835520 00000100:00100000:3.0:1788851309.507604:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788851309.507608:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019835520:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788851309.507622:0:17213:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788851309.507646:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019835520:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 36us (84us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788851309.507651:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788851309.507672:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c52000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851309.507676:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788851309.509092:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019835520:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788851309.511321:0:18246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875746019834240:12345-0@lo:38:kworker.0 Request processed in 11637us (12183us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788851309.511334:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788851309.511932:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e88fa7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851309.511938:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788851309.511942:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019834240:0@lo:38:kworker.0 00000100:00080000:1.0:1788851309.532272:0:3647:0:(import.c:65:import_set_state_nolock()) ffff892d81a65800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851309.532285:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 597 00000100:00080000:1.0:1788851309.532299:0:3647:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff892d81a65800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851309.532341:0:3647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e8707a680 x1875746019835648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851309.532380:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019835008:0@lo:400:kworker.0 00000100:00100000:1.0:1788851309.532430:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019834496:0@lo:400:kworker.0 00000100:00100000:3.0:1788851309.532760:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019835648:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788851309.532848:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851309.532951:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019835648 00000100:00100000:2.0:1788851309.532960:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019835648 00000100:00100000:2.0:1788851309.533003:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788851309.533027:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019835648:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788851309.533044:0:17212:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788851309.533092:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019835648:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 80us (244us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851309.533099:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788851309.533213:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d81a65800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851309.533219:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788851309.533222:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019835648:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788851310.004233:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019835776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851310.004305:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851310.004370:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019835776 00000100:00100000:2.0:1788851310.004378:0:18722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019835776 00000100:00100000:2.0:1788851310.004451:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788851310.004460:0:18722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019835776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788851310.004491:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788851310.004542:0:18722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019835776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851310.004548:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788851310.004647:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019835776:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1788851310.005941:0:19531:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788851310.005947:0:19531:0:(genops.c:885:class_export_put()) final put ffff892d815a9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788851310.006036:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d815a9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788851310.006093:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d815aa800 for lustre-OST0001 00000001:00100000:3.0:1788851310.006666:0:18715:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788851310.006671:0:18715:0:(genops.c:885:class_export_put()) final put ffff892eacd5c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788851310.006744:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892eacd5c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788851310.006795:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892eacd5b800 for lustre-OST0000 00000040:00080000:3.0:1788851310.324754:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788851310.388198:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788851310.580160:0:20780:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892d85cff780 - data ffff892eb3548000/ffff892d81e68c00 00000020:01000000:1.0:1788851310.580331:0:20780:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892d87404060 - data ffff892eb3452948/ffff892e86de3c00 00000001:00000004:1.0:1788851310.594383:0:20780:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1788851310.671975:0:20780:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788851310.671986:0:20780:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788851310.672001:0:20780:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff892d87b74a80 x1875746019833344/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788851314 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851310.672051:0:20780:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788851310.674846:0:20780:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788851310.674854:0:20780:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1788851310.674873:0:20780:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788851310.674876:0:20780:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788851310.675724:0:17236:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788851310.675744:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788851310.675754:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788851310.679743:0:20780:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788851310.679751:0:20780:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1788851310.679856:0:20780:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788851310.679868:0:20780:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788851310.683413:0:17238:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788851310.683422:0:17238:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1788851310.683442:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788851310.684630:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206a4d 00000020:00000080:2.0:1788851310.684640:0:20780:0:(genops.c:885:class_export_put()) final put ffff892ea570d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788851310.685382:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea570d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788851310.685981:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206a62 00000020:00000080:2.0:1788851310.685991:0:20780:0:(genops.c:885:class_export_put()) final put ffff892e84bc8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788851310.686024:0:20780:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788851310.686030:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851310.686039:0:20780:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788851310.686043:0:20780:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff892d874a0000) has no exports 00000004:01000000:2.0:1788851310.686246:0:20780:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788851310.686254:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206ac4 00000020:00000080:2.0:1788851310.686258:0:20780:0:(genops.c:885:class_export_put()) final put ffff892e82cc5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788851310.686263:0:20780:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788851310.686266:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851310.686279:0:20780:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788851310.686282:0:20780:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff892d85f24d40) has no exports 00000020:00000080:2.0:1788851310.686288:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206abd 00000020:00000080:2.0:1788851310.686291:0:20780:0:(genops.c:885:class_export_put()) final put ffff892e88542000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788851310.688831:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e84bc8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788851310.688850:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e82cc5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788851310.688855:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e88542000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788851310.689088:0:20780:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788851310.689094:0:20780:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788851310.689099:0:20780:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1788851310.689106:0:20780:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788851310.689109:0:20780:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788851310.689152:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892e88540000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788851310.689465:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851310.689476:0:20780:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788851310.689482:0:20780:0:(genops.c:885:class_export_put()) final put ffff892e82cc1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788851310.689485:0:20780:0:(genops.c:844:class_export_destroy()) destroying export ffff892e82cc1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788851310.689490:0:20780:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788851310.689573:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206aaf 00000020:00000080:2.0:1788851310.689580:0:20780:0:(genops.c:885:class_export_put()) final put ffff892e82cc2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788851310.689596:0:20780:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788851310.689600:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851310.689605:0:20780:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788851310.689608:0:20780:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff892ebbbcb380) has no exports 00000020:00000080:2.0:1788851310.689613:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206aa8 00000020:00000080:2.0:1788851310.689617:0:20780:0:(genops.c:885:class_export_put()) final put ffff892e82cc6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788851310.689632:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e82cc2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788851310.689642:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e82cc6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788851310.693118:0:20780:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788851310.693128:0:20780:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788851310.693132:0:20780:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1788851310.693141:0:20780:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788851310.693143:0:20780:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788851310.693195:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851310.693206:0:20780:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788851310.693222:0:20780:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788851310.693229:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206a9a 00000020:00000080:2.0:1788851310.693239:0:20780:0:(genops.c:885:class_export_put()) final put ffff892e82cc6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788851310.693247:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea5769000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788851310.693257:0:37:0:(genops.c:885:class_export_put()) final put ffff892e82cc0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788851310.693262:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e82cc0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788851310.693268:0:20780:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:01000000:1.0:1788851310.693270:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788851310.693286:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851310.693292:0:20780:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788851310.693296:0:20780:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff892d874a4d40) has no exports 00000020:00000080:2.0:1788851310.693302:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206a93 00000020:00000080:2.0:1788851310.693307:0:20780:0:(genops.c:885:class_export_put()) final put ffff892ea576d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788851310.693370:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e82cc6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788851310.693380:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea576d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788851310.711219:0:20780:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788851310.711230:0:20780:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788851310.711235:0:20780:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788851310.711244:0:20780:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788851310.711317:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851310.711330:0:20780:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851310.711372:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851310.711376:0:20780:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851310.711382:0:20780:0:(genops.c:885:class_export_put()) final put ffff892ea570a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788851310.711387:0:20780:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea570a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788851310.711397:0:20780:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851310.711499:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206a69 00000020:00000080:0.0:1788851310.711517:0:20780:0:(genops.c:885:class_export_put()) final put ffff892e84bcb000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788851310.711523:0:20780:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788851310.711527:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851310.711532:0:20780:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788851310.711536:0:20780:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff892d874a3380) has no exports 00000020:00000080:0.0:1788851310.711557:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851310.711561:0:20780:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788851310.711565:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206a70 00000020:00000080:0.0:1788851310.711569:0:20780:0:(genops.c:885:class_export_put()) final put ffff892e84bcb800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788851310.711577:0:20780:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892e84cde000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788851310.711580:0:20780:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892e84cde000 3 00000020:01000004:0.0:1788851310.711583:0:20780:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff892e84cde000 from lustre-MDT0000 00000020:00000080:0.0:1788851310.711600:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851310.711603:0:20780:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788851310.711606:0:20780:0:(genops.c:885:class_export_put()) final put ffff892ea570d800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788851310.711608:0:20780:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea570d800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788851310.711631:0:20780:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788851310.711661:0:20780:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788851310.711665:0:20780:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788851310.711669:0:20780:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788851310.711672:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851310.711674:0:20780:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788851310.711681:0:20780:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff892ea568b800 6a8a82bd-f416-4736-bb65-b562856c988b 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788851310.711686:0:20780:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff892d87ac0000) has exports, disconnecting them 00000020:00080000:0.0:1788851310.711691:0:20780:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff892ea568b800), last request at 1788851215 00000020:00000080:0.0:1788851310.711708:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206a15 00000020:00010000:0.0:1788851310.711712:0:20780:0:(genops.c:1920:obd_stale_export_put()) Put export ffff892ea568b800: total 2 00000100:00080000:0.0:1788851310.711716:0:20780:0:(import.c:65:import_set_state_nolock()) ffff892ea568c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788851310.711731:0:20780:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892ea568b800): rc 0 00000020:00080000:0.0:1788851310.711735:0:20780:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff892d87ac0000) has no exports 00000020:00010000:0.0:1788851310.711744:0:17201:0:(genops.c:1906:obd_stale_export_get()) Get export ffff892ea568b800: total 2 00010000:00010000:0.0:1788851310.711780:0:17201:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff892ea568b800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788851310.711809:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea55bca00/0x3e0030720b206c76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206c6f expref: 14 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711824:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e7400/0x3e0030720b206dd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206dcd expref: 13 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711837:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80031400/0x3e0030720b206b34 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206b2d expref: 12 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711850:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6800/0x3e0030720b206ca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206c99 expref: 11 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711860:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827eae00/0x3e0030720b206fcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206fc5 expref: 10 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711880:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e8a8b9a00/0x3e0030720b206bf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206bea expref: 9 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711890:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e7800/0x3e0030720b206b42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206b3b expref: 8 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711900:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea55bc000/0x3e0030720b206dfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206df7 expref: 7 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711909:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e7a00/0x3e0030720b206a23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206a1c expref: 6 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711928:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e6400/0x3e0030720b206e3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206e36 expref: 5 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711939:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433c600/0x3e0030720b206fda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206fd3 expref: 4 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711948:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892d876e7200/0x3e0030720b206b50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206b49 expref: 3 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711959:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e9eeba800/0x3e0030720b206fe8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e0030720b206fe1 expref: 2 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851310.711969:0:17201:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff892ea568b800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788851310.711982:0:17201:0:(genops.c:885:class_export_put()) final put ffff892ea568b800/6a8a82bd-f416-4736-bb65-b562856c988b 00010000:00010000:0.0:1788851310.711987:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851310.711988:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851310.711991:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788851310.712206:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea576a000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788851310.712215:0:37:0:(genops.c:885:class_export_put()) final put ffff892ea576a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788851310.712217:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea576a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788851310.712225:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788851310.712280:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e84bcb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788851310.712284:0:37:0:(genops.c:885:class_export_put()) final put ffff892e861b5000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788851310.712286:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e861b5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788851310.712289:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788851310.712308:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e84bcb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788851310.712312:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea568b800/6a8a82bd-f416-4736-bb65-b562856c988b for MGS 00000020:00000080:1.0:1788851310.712341:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea568c000 for MGS 00000100:00100000:2.0:1788851310.712547:0:17207:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff892d86b0a200:17207] 2 exiting: rc = 0 00000100:00100000:2.0:1788851310.712655:0:17206:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff892d86b0bc00:17206] 1 exiting: rc = 0 00000100:00100000:2.0:1788851310.714836:0:17205:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff892d86b0aa00:17205] 0 exiting: rc = 1 00000100:00100000:0.0:1788851310.714975:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.714986:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.714995:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715004:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715045:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715053:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715066:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715080:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715086:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715093:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715101:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715107:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715113:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715119:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715126:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715133:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715140:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715145:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715151:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715157:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715163:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715170:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715175:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715181:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715186:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715192:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715197:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715202:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715208:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715213:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715218:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715223:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715228:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715233:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715239:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715257:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715263:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715268:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715273:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715278:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715283:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715288:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715295:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715301:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715306:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715311:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715316:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715321:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715327:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715332:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715337:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715357:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715362:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715366:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715372:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715376:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715381:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715387:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715392:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715398:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715403:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715410:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715415:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851310.715421:0:20780:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788851310.734183:0:20780:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892d85f5fb40 - data ffff892eb3590360/ffff892d85ca2400 00000020:01000000:1.0:1788851310.734448:0:20780:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892d87404a80 - data ffff892e89730438/ffff892eab21e400 00000020:00000080:1.0:1788851310.735071:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2069f9 00000020:00000080:1.0:1788851310.735086:0:20780:0:(genops.c:885:class_export_put()) final put ffff892d882f8800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788851310.735111:0:20780:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892e84cde000 from MGS, refs=2 00000020:01000004:1.0:1788851310.735115:0:20780:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892e84cde000 2 00000020:01000004:1.0:1788851310.735119:0:20780:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff892e84cde000 from MGS 00000020:00000080:1.0:1788851310.735142:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851310.735149:0:20780:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788851310.735151:0:20780:0:(genops.c:885:class_export_put()) final put ffff892d882fb800/MGS 00000020:00000080:1.0:1788851310.735154:0:20780:0:(genops.c:844:class_export_destroy()) destroying export ffff892d882fb800/MGS for MGS 00000020:01000000:1.0:1788851310.735162:0:20780:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1788851310.735162:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d882f8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788851310.735237:0:20780:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788851310.735242:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851310.735248:0:20780:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788851310.735255:0:20780:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff892ea556e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788851310.735260:0:20780:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff892ebbbc8000) has exports, disconnecting them 00000020:00080000:1.0:1788851310.735265:0:20780:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff892ea556e000), last request at 1788851215 00000020:00000080:1.0:1788851310.735268:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206afc 00000020:00080000:1.0:1788851310.735278:0:20780:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892ea556e000): rc 0 00000020:00000080:1.0:1788851310.735283:0:20780:0:(genops.c:885:class_export_put()) final put ffff892ea556e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788851310.735419:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea556e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788851310.738093:0:20780:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788851310.738104:0:20780:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851310.738108:0:20780:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788851310.738135:0:20780:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788851310.738194:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea5569800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788851310.738484:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851310.738498:0:20780:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788851310.738506:0:20780:0:(genops.c:885:class_export_put()) final put ffff892ea5709800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788851310.738522:0:20780:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea5709800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788851310.738528:0:20780:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788851310.738609:0:20780:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892e84cde000 1 00000020:00000080:0.0:1788851310.738616:0:20780:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b2069eb 00000020:00000080:0.0:1788851310.738623:0:20780:0:(genops.c:885:class_export_put()) final put ffff892d882fd800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788851310.738632:0:20780:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788851310.738640:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d882fd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788851310.738651:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851310.738656:0:20780:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788851310.738660:0:20780:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff892d85f20000) has no exports 00000020:00000080:3.0:1788851310.922436:0:20780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788851310.922448:0:20780:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788851310.922454:0:20780:0:(genops.c:885:class_export_put()) final put ffff892e84cdc800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788851310.922458:0:20780:0:(genops.c:844:class_export_destroy()) destroying export ffff892e84cdc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788851310.922469:0:20780:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788851310.922575:0:20780:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff892e84cdd000 00000020:02000400:3.0:1788851310.922631:0:20780:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788851311.413182:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851312.440936:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851313.473340:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788851314.234000:0:20982:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788851314.247752:0:20982:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788851314.247820:0:20982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.247834:0:20982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.247841:0:20982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.247848:0:20982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.247871:0:20982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788851314.247876:0:20982:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788851314.247901:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788851314.247905:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788851314.247924:0:20982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788851314.247930:0:20982:0:(import.c:65:import_set_state_nolock()) ffff892d85c52000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788851314.247935:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788851314.247937:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788851314.247940:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788851314.248806:0:20982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248820:0:20982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248827:0:20982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248834:0:20982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248862:0:20982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788851314.248869:0:20982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248875:0:20982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248882:0:20982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248888:0:20982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248909:0:20982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788851314.248916:0:20982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248923:0:20982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248929:0:20982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248934:0:20982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248941:0:20982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788851314.248945:0:20982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248952:0:20982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248958:0:20982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248963:0:20982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851314.248968:0:20982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1788851314.248972:0:20982:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788851314.249002:0:20982:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788851314.249006:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788851314.249009:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788851314.249044:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788851314.249051:0:20982:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff892d815aa000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788851314.249056:0:20982:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff892d81a18000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788851314.249061:0:20982:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff892ead6d8000) has exports, disconnecting them 00000020:00080000:3.0:1788851314.249065:0:20982:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff892d815aa000), last request at 1788851309 00000020:00000080:3.0:1788851314.249071:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206e28 00000100:00080000:3.0:1788851314.249088:0:20982:0:(import.c:65:import_set_state_nolock()) ffff892d815a9800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788851314.249144:0:20982:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d815aa000): rc 0 00000020:00000080:3.0:1788851314.249147:0:20982:0:(genops.c:885:class_export_put()) final put ffff892d815aa000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788851314.249163:0:20982:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff892d81a18000), last request at 1788851309 00000020:00000080:3.0:1788851314.249167:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206cca 00000100:00080000:3.0:1788851314.249173:0:20982:0:(import.c:65:import_set_state_nolock()) ffff892d81a1e000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788851314.249179:0:20982:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d81a18000): rc 0 00000020:00000080:3.0:1788851314.249181:0:20982:0:(genops.c:885:class_export_put()) final put ffff892d81a18000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788851314.249187:0:20982:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa99041cabae0 00000100:00080000:3.0:1788851314.249204:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788851314.249213:0:20982:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff892d8839b480 x1875746019833856/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788851321 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851314.249227:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788851314.249925:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788851314.249935:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.249945:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b8c00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851314.249948:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.249958:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851314.249966:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851314.249985:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851314.249988:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788851314.249991:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1788851314.250043:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019833856:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788851314.250043:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250050:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788851314.250066:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788851314.250067:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250073:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e8a8b8c00/0x3e0030720b206bea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206bf1 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851314.250075:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019835904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851314.250085:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788851314.250088:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250092:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851314.250094:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250101:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851314.250106:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851314.250136:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788851314.250192:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851314.250194:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00000100:00080000:3.0:1788851314.250200:0:20982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 10000000:01000000:0.0:1788851314.250201:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000100:00080000:3.0:1788851314.250204:0:20982:0:(import.c:65:import_set_state_nolock()) ffff892e88fa7000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1788851314.250216:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250221:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851314.250230:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250236:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9200/0x3e0030720b206b49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206b50 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851314.250242:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019836032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851314.250245:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788851314.250248:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250253:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bda00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851314.250256:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250263:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851314.250264:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1788851314.250270:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851314.250275:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851314.250278:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788851314.250279:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788851314.250372:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250379:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851314.250411:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250417:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea55bda00/0x3e0030720b206e36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206e3d expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250431:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851314.250435:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250441:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94800 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851314.250443:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250450:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851314.250456:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851314.250461:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788851314.250462:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788851314.250464:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788851314.250477:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250483:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851314.250488:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250494:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebff94800/0x3e0030720b206fe1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206fe8 expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250512:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851314.250516:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250522:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e8a8b9600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851314.250525:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250531:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851314.250537:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851314.250543:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851314.250545:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788851314.250547:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788851314.250561:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250567:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851314.250578:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250585:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9600/0x3e0030720b206b3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e0030720b206b42 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851314.250595:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851314.250597:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851314.250599:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851314.250604:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851314.250619:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019835904 00000100:00100000:0.0:1788851314.250627:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019835904 00000100:00100000:0.0:1788851314.250748:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019836032 00000100:00100000:0.0:1788851314.250752:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019836032 00000100:00100000:0.0:1788851314.250771:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788851314.250778:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875746019835904:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788851314.250786:0:17197:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788851314 with bad export cookie 4467624096722610709 00000100:00100000:2.0:1788851314.252706:0:18367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788851314.252725:0:18367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875746019836032:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788851314.252733:0:18367:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788851314 with bad export cookie 4467624096722610709 00000100:00100000:2.0:1788851314.252827:0:18367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875746019836032:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (2560us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788851314.252834:0:18367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788851314.252876:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019836288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851314.252912:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851314.252942:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788851314.252948:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019836160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851314.252970:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851314.252996:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019836288 00000100:00100000:2.0:1788851314.253002:0:17199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019836288 00000100:00100000:2.0:1788851314.253037:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019836160 00000100:00100000:2.0:1788851314.253040:0:17199:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019836160 00000100:00100000:2.0:1788851314.253051:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788851314.253056:0:17199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1875746019836288:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788851314.253061:0:17199:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788851314 with bad export cookie 4467624096722610709 00000100:00100000:2.0:1788851314.253105:0:17199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1875746019836288:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (192us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788851314.253112:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788851314.253126:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788851314.253130:0:17199:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1875746019836160:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788851314.253134:0:17199:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788851314 with bad export cookie 4467624096722610709 00000100:00100000:2.0:1788851314.253157:0:17199:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1875746019836160:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (186us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788851314.253163:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788851314.253193:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788851314.253198:0:3650:0:(import.c:65:import_set_state_nolock()) ffff892e983ab000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788851314.253201:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00000080:1.0:1788851314.253471:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d815aa000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788851314.253597:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d81a18000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788851314.253624:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d815a9800 for lustre-MDT0001 00000020:00000080:1.0:1788851314.253629:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d81a1e000 for lustre-MDT0001 00000100:00080000:3.0:1788851314.255168:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1788851314.260609:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875746019835904:12345-0@lo:103:ldlm_bl.0 Request processed in 9825us (10467us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788851314.260708:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788851314.285191:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.127@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788851314.285197:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788851314.285207:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892eb694d500 x1875746019835904/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788851330 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851314.285221:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892eb694c380 x1875746019836032/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788851330 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851314.285230:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892eb694e680 x1875746019836288/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788851330 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851314.285240:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892eb694dc00 x1875746019836160/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788851330 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851314.285395:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a8a82bd-f416-4736-bb65-b562856c988b:0:1875746019836416:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1788851314.285610:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788851314.285665:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788851314.285667:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788851314.285671:0:3650:0:(import.c:65:import_set_state_nolock()) ffff892e983ab000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851314.285676:0:3650:0:(import.c:545:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 549 00000100:00080000:2.0:1788851314.285702:0:3650:0:(import.c:666:import_select_connection()) MGC192.168.204.127@tcp: import ffff892e983ab000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851314.285884:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea590ca80 x1875746019836544/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788851314.285927:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019836288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851314.285943:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a8a82bd-f416-4736-bb65-b562856c988b:3650:1875746019836160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851314.285993:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6a8a82bd-f416-4736-bb65-b562856c988b:3646:1875746019836544:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1788851314.286042:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff892e983ab000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:3.0:1788851314.286055:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019835904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851314.286067:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a8a82bd-f416-4736-bb65-b562856c988b:3648:1875746019836032:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788851314.286140:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788851314.286144:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788851314.286165:0:20982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788851314.286222:0:20982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788851314.286236:0:20982:0:(import.c:65:import_set_state_nolock()) ffff892eab226800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788851314.286243:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788851314.286246:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788851314.286253:0:20982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788851314.286310:0:20982:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788851314.286319:0:20982:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788851314.286360:0:20982:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff892ead6d8000) has no exports 00000400:00000100:1.0:1788851314.286449:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875746019836544 offset 0 length 520: 4 00000100:00100000:1.0:1788851314.286487:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019836672:0@lo:9:umount.0 00000100:00100000:1.0:1788851314.286603:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851314.286741:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019836800:0@lo:9:umount.0 00000100:00100000:1.0:1788851314.286766:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851314.287490:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019836672 00000100:00100000:3.0:1788851314.287502:0:18720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019836672 00000100:00100000:2.0:1788851314.287770:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019836800 00000100:00100000:3.0:1788851314.287792:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788851314.287803:0:18720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875746019836672:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788851314.287904:0:18720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206cf4 00000100:00080000:3.0:1788851314.287913:0:18720:0:(import.c:65:import_set_state_nolock()) ffff892d81b6b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788851314.287957:0:18720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:1.0:1788851314.287982:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851314.288008:0:18719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019836800 00000100:00080000:0.0:1788851314.288076:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851314.288167:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788851314.288175:0:18719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875746019836800:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788851314.288200:0:18719:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206e59 00000100:00080000:2.0:1788851314.288206:0:18719:0:(import.c:65:import_set_state_nolock()) ffff892d815ab800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788851314.288235:0:18719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788851314.288325:0:18719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3646:x1875746019836800:12345-0@lo:9:umount.0 Request processed in 150us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851314.288332:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788851314.288376:0:18720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3646:x1875746019836672:12345-0@lo:9:umount.0 Request processed in 575us (1771us total) trans 0 rc 0/0 00000100:00080000:1.0:1788851314.288380:0:17208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851314.288383:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788851314.288392:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788851314.288423:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eab226800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788851314.288442:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788851314.288444:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788851314.288448:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019836672:0@lo:9:umount.0 00000100:00080000:1.0:1788851314.288460:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea4358800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788851314.288467:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788851314.288468:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788851314.288471:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019836800:0@lo:9:umount.0 00000020:00080000:1.0:1788851314.306044:0:20982:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff892ead6d8000) has no exports 00000020:01000000:2.0:1788851314.379758:0:20982:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892d85cff8a0 - data ffff892eb36f1d80/ffff892d81e6a400 00000020:01000000:2.0:1788851314.379944:0:20982:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892e8705b360 - data ffff892d86006d80/ffff892ebbc05800 00000001:00000004:2.0:1788851314.395199:0:20982:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:1.0:1788851314.455721:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788851314.455730:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788851314.455737:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788851314.458302:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788851314.458310:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788851314.458332:0:20982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788851314.458334:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788851314.458570:0:17952:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788851314.458575:0:17952:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1788851314.458585:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788851314.463152:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788851314.463166:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788851314.463192:0:20982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788851314.463195:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788851314.464158:0:17954:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788851314.464165:0:17954:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1788851314.464175:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788851314.465675:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206b5e 00000020:00000080:1.0:1788851314.465697:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e88fa3000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788851314.465890:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e88fa3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788851314.467280:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206b73 00000020:00000080:1.0:1788851314.467293:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e90e50000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788851314.467355:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788851314.467361:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851314.467375:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788851314.467379:0:20982:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff892ead6dcd40) has no exports 00000004:01000000:1.0:1788851314.467573:0:20982:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788851314.467585:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206bc7 00000020:00000080:1.0:1788851314.467591:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e83e2c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788851314.468449:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e90e50000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788851314.468513:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788851314.468520:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851314.468530:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788851314.468534:0:20982:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff892ebbbccd40) has no exports 00000020:00000080:1.0:1788851314.468542:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206bc0 00000020:00000080:1.0:1788851314.468551:0:20982:0:(genops.c:885:class_export_put()) final put ffff892ea4358000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788851314.468701:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e2c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788851314.469237:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea4358000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788851314.469623:0:20982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788851314.469629:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788851314.469634:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788851314.469641:0:20982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788851314.469643:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788851314.469739:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851314.469748:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788851314.469758:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206bb2 00000020:00000080:1.0:1788851314.469766:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e87c1a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788851314.470503:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892ea4358800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788851314.470513:0:37:0:(genops.c:885:class_export_put()) final put ffff892e87c1d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788851314.470516:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e87c1d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788851314.470522:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788851314.470759:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788851314.470767:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851314.470774:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788851314.470782:0:20982:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff892ead6db380) has no exports 00000020:00000080:1.0:1788851314.470790:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206bab 00000020:00000080:1.0:1788851314.470795:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e9a198000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788851314.470900:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e87c1a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788851314.470907:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e9a198000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788851314.471405:0:20982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788851314.471410:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788851314.471414:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788851314.471419:0:20982:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788851314.471433:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788851314.471514:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851314.471521:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788851314.471537:0:20982:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788851314.471543:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206b96 00000020:00000080:1.0:1788851314.471549:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e87c19800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788851314.475230:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892eab226800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788851314.475250:0:37:0:(genops.c:885:class_export_put()) final put ffff892e90e57000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788851314.475254:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e90e57000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788851314.475261:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788851314.476171:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788851314.476202:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851314.476213:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788851314.476219:0:20982:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff892eb6f419c0) has no exports 00000020:00000080:1.0:1788851314.476230:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206b8f 00000020:00000080:1.0:1788851314.476237:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e88fa7800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788851314.478115:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e87c19800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788851314.492635:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e88fa7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788851314.507116:0:20982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788851314.507125:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788851314.507130:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788851314.507138:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788851314.507209:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851314.507223:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788851314.507268:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851314.507287:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788851314.507292:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e88fa1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788851314.507296:0:20982:0:(genops.c:844:class_export_destroy()) destroying export ffff892e88fa1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788851314.507303:0:20982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788851314.507475:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206b7a 00000020:00000080:2.0:1788851314.507483:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e90e54800/lustre-MDD0001_UUID 00000020:01000000:2.0:1788851314.507488:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788851314.507491:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851314.507496:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788851314.507500:0:20982:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff892ead6d99c0) has no exports 00000020:00000080:2.0:1788851314.507536:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851314.507540:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788851314.507543:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206b81 00000020:00000080:2.0:1788851314.507547:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e90e56000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788851314.507555:0:20982:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892eb6cf0800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788851314.507558:0:20982:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892eb6cf0800 2 00000020:01000004:2.0:1788851314.507561:0:20982:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff892eb6cf0800 from lustre-MDT0001 00000020:00000080:2.0:1788851314.507581:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851314.507585:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788851314.507587:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e88fa5800/lustre-MDT0001_UUID 00000020:00000080:2.0:1788851314.507590:0:20982:0:(genops.c:844:class_export_destroy()) destroying export ffff892e88fa5800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788851314.507596:0:20982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788851314.507637:0:20982:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788851314.507641:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788851314.507644:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851314.507648:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788851314.507654:0:20982:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff892d85c50000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788851314.507659:0:20982:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff892eb6f44d40) has exports, disconnecting them 00000020:00080000:2.0:1788851314.507664:0:20982:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff892d85c50000), last request at 1788851228 00000020:00000080:2.0:1788851314.507668:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206bff 00000020:00080000:2.0:1788851314.507679:0:20982:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d85c50000): rc 0 00000020:00000080:2.0:1788851314.507700:0:20982:0:(genops.c:885:class_export_put()) final put ffff892d85c50000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788851314.507729:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892e88fa7000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788851314.507741:0:37:0:(genops.c:885:class_export_put()) final put ffff892e87c1b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788851314.507743:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e87c1b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788851314.507754:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788851314.507861:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e90e54800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788851314.507866:0:37:0:(genops.c:885:class_export_put()) final put ffff892eab221000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788851314.507868:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892eab221000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788851314.507878:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788851314.508005:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e90e56000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788851314.508010:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d85c50000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788851314.554507:0:20982:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788851314.554517:0:20982:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788851314.554530:0:20982:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788851314.554537:0:20982:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788851314.554571:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d85c52000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788851314.554770:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788851314.554778:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788851314.554783:0:20982:0:(genops.c:885:class_export_put()) final put ffff892d85c52800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788851314.554796:0:20982:0:(genops.c:844:class_export_destroy()) destroying export ffff892d85c52800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788851314.554813:0:20982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788851314.554882:0:20982:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892eb6cf0800 1 00000020:00000080:3.0:1788851314.554888:0:20982:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206b26 00000020:00000080:3.0:1788851314.554894:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e83e29800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788851314.554902:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788851314.554908:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e29800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788851314.554914:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788851314.554918:0:20982:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788851314.554922:0:20982:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff892ebbbc99c0) has no exports 00000100:00080000:3.0:1788851314.627703:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788851314.627721:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788851314.627725:0:37:0:(import.c:65:import_set_state_nolock()) ffff892d85f3b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851314.627735:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 643 00000100:00080000:3.0:1788851314.627740:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788851314.627754:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff892d85f3b800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851314.627796:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d8839b100 x1875746019836928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851314.627862:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788851314.627866:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788851314.627868:0:37:0:(import.c:65:import_set_state_nolock()) ffff892d81a65800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851314.627872:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 643 00000100:00080000:3.0:1788851314.627875:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788851314.627879:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff892d81a65800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851314.627890:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d88399500 x1875746019837184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851314.627934:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019837056:0@lo:400:kworker.0 00000100:00100000:3.0:1788851314.627998:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851314.628067:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019837312:0@lo:400:kworker.0 00000100:00100000:3.0:1788851314.628092:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851314.628124:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019837056 00000100:00100000:3.0:1788851314.628133:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019837056 00000100:00100000:3.0:1788851314.628164:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019837312 00000100:00100000:3.0:1788851314.628167:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019837312 00000100:00100000:3.0:1788851314.628183:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788851314.628191:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875746019837056:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788851314.628198:0:18245:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788851314.628233:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875746019837056:12345-0@lo:400:kworker.0 Request processed in 42us (234us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788851314.628239:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788851314.628257:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788851314.628261:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875746019837312:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788851314.628266:0:18245:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788851314.628299:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875746019837312:12345-0@lo:400:kworker.0 Request processed in 35us (206us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788851314.628305:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788851314.628379:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788851314.628383:0:3649:0:(import.c:65:import_set_state_nolock()) ffff892eb6996000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788851314.628386:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788851314.633477:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019836928:0@lo:38:kworker.0 00000100:00100000:1.0:1788851314.633574:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851314.633627:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019837184:0@lo:38:kworker.0 00000100:00100000:1.0:1788851314.633652:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851314.633733:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019836928 00000100:00100000:1.0:1788851314.633744:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019836928 00000100:00100000:1.0:1788851314.633787:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019837184 00000100:00100000:1.0:1788851314.633790:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019837184 00000100:00100000:1.0:1788851314.633810:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788851314.633818:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019836928:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788851314.633839:0:17213:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788851314.633916:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788851314.633923:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019837184:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788851314.633933:0:17212:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788851314.634003:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019837184:12345-0@lo:38:kworker.0 Request processed in 78us (349us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851314.634010:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788851314.634091:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d81a65800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851314.634097:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851314.634101:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019837184:0@lo:38:kworker.0 00000100:00080000:2.0:1788851314.635757:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788851314.635764:0:3648:0:(import.c:65:import_set_state_nolock()) ffff892d81a18800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788851314.635769:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788851314.635774:0:3648:0:(import.c:65:import_set_state_nolock()) ffff892d81a18800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851314.635778:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 577 00000100:00080000:2.0:1788851314.635789:0:3648:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff892d81a18800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851314.635822:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea590fb80 x1875746019837440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788851314.635848:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019837056:0@lo:400:kworker.0 00000100:00100000:2.0:1788851314.635879:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875746019837440:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788851314.635950:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851314.636006:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019837440 00000100:00100000:2.0:1788851314.636028:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019837440 00000100:00100000:2.0:1788851314.636206:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788851314.636228:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019837440:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788851314.636248:0:17212:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788851314.636289:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019837440:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 61us (339us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851314.636295:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788851314.636327:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d81a18800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851314.636332:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851314.636335:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875746019837440:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788851314.646859:0:3649:0:(import.c:65:import_set_state_nolock()) ffff892eb6996000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851314.646869:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 597 00000100:00080000:3.0:1788851314.646885:0:3649:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff892eb6996000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851314.646929:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d88398e00 x1875746019837568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851314.646957:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019837312:0@lo:400:kworker.0 00000100:00100000:2.0:1788851314.647619:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875746019837568:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788851314.647695:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851314.647741:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019837568 00000100:00100000:2.0:1788851314.647749:0:18245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019837568 00000100:00100000:2.0:1788851314.648533:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788851314.648542:0:18245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875746019837568:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788851314.648560:0:18245:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788851314.648612:0:18245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875746019837568:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 70us (917us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851314.648620:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788851314.648663:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eb6996000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851314.648667:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851314.648671:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875746019837568:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788851314.683440:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019836928:12345-0@lo:38:kworker.0 Request processed in 49612us (49856us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851314.683455:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788851314.683509:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85f3b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851314.683536:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851314.683540:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019836928:0@lo:38:kworker.0 00000020:00000080:2.0:1788851314.686639:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851314.686652:0:20982:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788851314.686658:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e88541000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788851314.686663:0:20982:0:(genops.c:844:class_export_destroy()) destroying export ffff892e88541000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788851314.686674:0:20982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788851314.687089:0:20982:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff892eb6cf5800 00000020:01000000:2.0:1788851314.687112:0:20982:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788851314.687117:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851314.687123:0:20982:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788851314.687127:0:20982:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff892d85f219c0) has no exports 00000100:00100000:2.0:1788851314.687252:0:18245:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff892eb6e66200:18245] 3 exiting: rc = 0 00000100:00100000:2.0:1788851314.687366:0:17212:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff892e92cd0800:17212] 0 exiting: rc = 1 00000100:00100000:2.0:1788851314.687455:0:17213:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff892e90dd5e00:17213] 1 exiting: rc = 0 00000100:00100000:1.0:1788851314.687589:0:17214:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff892e90dd4400:17214] 2 exiting: rc = 0 00000100:00100000:2.0:1788851314.687892:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687899:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687906:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687911:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687916:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687921:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687927:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687933:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687939:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687944:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687950:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687956:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687962:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687967:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687973:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.687978:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688110:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688131:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688137:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688142:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688149:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688153:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688159:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688164:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688170:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688175:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688181:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688186:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688192:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688198:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688203:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688210:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688215:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688221:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688227:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688232:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688238:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688243:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688249:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688254:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688269:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688276:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688281:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688286:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688292:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688297:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688303:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688307:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688312:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688317:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688322:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688327:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688342:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688347:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688353:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688358:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688364:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688370:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688376:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688381:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688386:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688391:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688395:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.688400:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.694899:0:17215:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff892ea5738800:17215] 0 exiting: rc = 1 00000100:00100000:1.0:1788851314.695903:0:17216:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff892e90dd4000:17216] 1 exiting: rc = 0 00000100:00100000:2.0:1788851314.696268:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696277:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696284:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696290:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696296:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696301:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696307:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696313:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696319:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696325:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696330:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696336:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696342:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696347:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696353:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696359:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696364:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696370:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696375:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696381:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696386:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696392:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696409:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696415:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696420:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696425:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696431:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696437:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696442:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696448:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696453:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696459:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696464:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696469:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696475:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696481:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696486:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696492:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696497:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696502:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696508:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696513:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696519:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696526:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696532:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696538:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696544:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696549:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696555:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696560:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696565:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696571:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696576:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696582:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696587:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696593:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696598:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696780:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696790:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696796:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696802:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696874:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696880:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.696885:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.697521:0:17218:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff892e8d8ff200:17218] 1 exiting: rc = 0 00000100:00100000:2.0:1788851314.697636:0:17217:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff892ea5739000:17217] 0 exiting: rc = 1 00000100:00100000:1.0:1788851314.697913:0:18246:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff892d87a98400:18246] 2 exiting: rc = 0 00000100:00100000:2.0:1788851314.698086:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698099:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698107:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698115:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698124:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698132:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698141:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698151:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698159:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698169:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698179:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698186:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698194:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698201:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698229:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698237:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698244:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698251:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698258:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698266:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698274:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698281:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698293:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698300:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698307:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698317:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698337:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698353:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698359:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698365:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698370:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698376:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698382:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698388:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698393:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698399:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698405:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698413:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698434:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698442:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698449:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698455:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698461:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698468:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698478:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698483:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698489:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698494:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698500:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698506:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698526:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698533:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698538:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698545:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698550:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698555:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698561:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698567:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698573:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698580:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698586:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698591:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.698603:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.700477:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.712852:0:17219:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff892e92d44c00:17219] 0 exiting: rc = 1 00000100:00100000:1.0:1788851314.713176:0:17220:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff892e92d45000:17220] 1 exiting: rc = 0 00000100:00100000:3.0:1788851314.713294:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713303:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713308:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713313:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713318:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713324:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713329:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713335:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713340:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713345:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713350:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713355:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713359:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713364:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713368:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713372:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713395:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713399:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713404:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713409:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713414:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713419:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713424:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713429:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713434:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713439:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713443:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713448:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713453:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713458:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713463:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713469:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713473:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713478:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713483:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713488:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713493:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713499:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713504:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713508:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713513:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713519:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713523:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713529:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713534:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713540:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713545:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713550:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713555:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713560:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713564:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713575:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713580:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713585:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713591:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713596:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713602:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713607:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713693:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713698:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713763:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713772:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713777:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.713782:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851314.714420:0:17221:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff892e92d44a00:17221] 0 exiting: rc = 1 00000100:00100000:2.0:1788851314.714514:0:17222:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff892e92d45a00:17222] 1 exiting: rc = 0 00000100:00100000:3.0:1788851314.714608:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714700:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714771:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714778:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714782:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714787:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714792:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714797:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714802:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714871:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714877:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714881:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714885:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714890:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714895:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714899:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714903:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714908:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714912:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714917:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714921:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714926:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714942:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714947:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714952:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714957:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714961:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714966:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714971:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714976:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.714981:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715256:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715261:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715266:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715270:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715275:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715279:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715284:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715290:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715296:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715300:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715305:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715310:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715316:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715321:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715327:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715331:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715336:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715341:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715346:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715351:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715355:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715360:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715365:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715370:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715375:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715379:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715392:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715397:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715401:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715405:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715410:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715415:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.715420:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851314.716190:0:17224:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff892e92d45600:17224] 1 exiting: rc = 0 00000100:00100000:2.0:1788851314.716342:0:17223:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff892e92d44400:17223] 0 exiting: rc = 1 00000100:00100000:3.0:1788851314.716444:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716450:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716454:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716459:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716464:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716469:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716473:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716477:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716482:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716488:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716493:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716498:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716503:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716509:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716514:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716519:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716524:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716530:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716538:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716545:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716552:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716559:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716565:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716572:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716579:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716587:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716596:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716602:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716697:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716765:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716774:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716778:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716783:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716788:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716793:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716798:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716870:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716878:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716884:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716889:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716894:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716899:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716905:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716910:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716916:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716921:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716926:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716932:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716936:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716941:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716947:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716952:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716957:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716963:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716970:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716975:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.716980:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.717150:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.717159:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.717164:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.717169:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.717174:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.717179:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.717190:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851314.717914:0:17225:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff892d85f0e000:17225] 0 exiting: rc = 1 00000100:00100000:1.0:1788851314.720489:0:17226:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff892d85f0f200:17226] 1 exiting: rc = 0 00000100:00100000:1.0:1788851314.720714:0:17227:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff892e9083c000:17227] 2 exiting: rc = 0 00000100:00100000:3.0:1788851314.720807:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720816:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720822:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720828:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720843:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720864:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720870:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720876:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720883:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720889:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720895:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720901:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720907:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720913:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720920:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720925:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720930:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720936:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720942:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720947:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720953:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720959:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720964:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720970:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720975:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720980:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720986:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720991:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.720996:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721037:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721044:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721050:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721056:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721061:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721079:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721085:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721090:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721096:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721102:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721107:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721113:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721118:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721123:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721129:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721135:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721141:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721147:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721152:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721157:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721163:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721168:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721173:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721179:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721197:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721205:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721211:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721217:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721223:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721230:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721236:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721242:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721248:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721253:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851314.721259:0:20982:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788851314.730276:0:20982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788851314.730290:0:20982:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788851314.730296:0:20982:0:(genops.c:885:class_export_put()) final put ffff892e983ac000/MDS_uuid 00000020:00000080:3.0:1788851314.730301:0:20982:0:(genops.c:844:class_export_destroy()) destroying export ffff892e983ac000/MDS_uuid for MDS 00000020:01000000:3.0:1788851314.730311:0:20982:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788851314.730461:0:20982:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788851314.984974:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851316.020220:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851317.045337:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851318.068236:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788851318.546694:0:21183:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788851318.563166:0:21183:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788851318.563223:0:21183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.563238:0:21183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.563246:0:21183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.563253:0:21183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.563280:0:21183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788851318.563286:0:21183:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788851318.563316:0:21183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788851318.563320:0:21183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788851318.563326:0:21183:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788851318.563334:0:21183:0:(import.c:65:import_set_state_nolock()) ffff892d85f3b800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788851318.563339:0:21183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788851318.563341:0:21183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788851318.563344:0:21183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788851318.564516:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851318.564526:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851318.564536:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851318.564539:0:17201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851318.564548:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851318.564555:0:17201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851318.564560:0:17201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851318.564563:0:17201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788851318.564565:0:17201:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788851318.564599:0:17201:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e983ab000 00010000:00010000:0.0:1788851318.564614:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851318.564621:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80030c00/0x3e0030720b206c99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206ca0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851318.564633:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851318.564635:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851318.564637:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788851318.564668:0:21183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788851318.564672:0:21183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788851318.564677:0:21183:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788851318.564681:0:21183:0:(import.c:65:import_set_state_nolock()) ffff892d81a18800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788851318.564690:0:21183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788851318.564692:0:21183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788851318.564694:0:21183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788851318.566939:0:21183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.566958:0:21183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.566966:0:21183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.566973:0:21183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.567001:0:21183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851318.567009:0:21183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851318.567064:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851318.567072:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851318.567080:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788851318.567084:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851318.567093:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788851318.567100:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851318.567107:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788851318.567110:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788851318.567120:0:17200:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e983ab000 00010000:00010000:2.0:1788851318.567124:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851318.567132:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80031600/0x3e0030720b206c6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206c76 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851318.567163:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851318.567165:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851318.567167:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851318.567516:0:21183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.567522:0:21183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.567528:0:21183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851318.569971:0:21183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788851318.569986:0:21183:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788851318.569992:0:21183:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788851318.570064:0:21183:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788851318.570068:0:21183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788851318.570076:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851318.570083:0:21183:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788851318.570092:0:21183:0:(genops.c:1818:print_export_data()) lustre-OST0000: UNLINKED ffff892d81b69000 lustre-MDT0001-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 8589934593 stale:0 00000020:00080000:0.0:1788851318.570099:0:21183:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff892eb6f40000) has no exports 00000020:00080000:0.0:1788851318.570125:0:21183:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff892eb6f40000) has no exports 00010000:00010000:1.0:1788851318.573589:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851318.573619:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.573651:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827eb600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851318.573656:0:17201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.573667:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851318.573675:0:17201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851318.573680:0:17201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788851318.573683:0:17201:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788851318.573687:0:17201:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788851318.573705:0:17201:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e983ab000 00010000:00010000:1.0:1788851318.573710:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.573718:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b206fd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206fda expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851318.573803:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851318.573805:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851318.573807:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851319.092193:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788851319.732455:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6a8a82bd-f416-4736-bb65-b562856c988b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788851319.732466:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6a8a82bd-f416-4736-bb65-b562856c988b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851319.732469:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788851319.732473:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788851319.732477:0:37:0:(import.c:65:import_set_state_nolock()) ffff892d81a65800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851319.732486:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1788851319.732493:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788851319.732507:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff892d81a65800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851319.732550:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892eb694ce00 x1875746019837696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851319.732594:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788851319.732598:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788851319.732600:0:37:0:(import.c:65:import_set_state_nolock()) ffff892eb6996000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851319.732603:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1788851319.732606:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788851319.732612:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff892eb6996000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851319.732624:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892eb694df80 x1875746019837824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851319.732776:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019837696:0@lo:38:kworker.0 00000400:00000100:3.0:1788851319.732827:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019837696 offset 0 length 520: 4 00000100:00100000:3.0:1788851319.732887:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875746019837824:0@lo:38:kworker.0 00000400:00000100:3.0:1788851319.732901:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019837824 offset 0 length 520: 4 00000001:00100000:3.0:1788851319.743763:0:18715:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788851319.743773:0:18715:0:(genops.c:885:class_export_put()) final put ffff892d81b69000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788851319.743860:0:19531:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788851319.743865:0:19531:0:(genops.c:885:class_export_put()) final put ffff892d815ad000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788851319.745175:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d81b69000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788851319.745234:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d815ad000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788851319.745252:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d81b6b000 for lustre-OST0000 00000020:00000080:2.0:1788851319.745256:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d815ab800 for lustre-OST0001 00010000:00010000:1.0:1788851320.116936:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788851320.629709:0:21183:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892d85f5f1e0 - data ffff892eb3408bd0/ffff892d85ca1000 00000020:01000000:1.0:1788851320.629877:0:21183:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892ea7c4d960 - data ffff892eb34fae58/ffff892d88292800 00100000:10000000:1.0:1788851320.640673:0:21183:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788851320.652824:0:21183:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206c84 00000020:00000080:0.0:1788851320.652836:0:21183:0:(genops.c:885:class_export_put()) final put ffff892d875ea800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788851320.652897:0:21183:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892ea4305000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788851320.652901:0:21183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ea4305000 2 00000020:01000004:0.0:1788851320.652905:0:21183:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff892ea4305000 from lustre-OST0000 00000020:00000080:0.0:1788851320.652928:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851320.652937:0:21183:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788851320.652941:0:21183:0:(genops.c:885:class_export_put()) final put ffff892d875e9000/lustre-OST0000_UUID 00000020:00000080:0.0:1788851320.652944:0:21183:0:(genops.c:844:class_export_destroy()) destroying export ffff892d875e9000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788851320.652951:0:21183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788851320.652993:0:21183:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788851320.652997:0:21183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788851320.653000:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851320.653005:0:21183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788851320.653028:0:21183:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff892d81a1b800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788851320.653034:0:21183:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff892eb6f43380) has exports, disconnecting them 00000020:00080000:0.0:1788851320.653039:0:21183:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff892d81a1b800), last request at 1788851243 00000020:00000080:0.0:1788851320.653051:0:21183:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206cae 00000020:00080000:0.0:1788851320.653060:0:21183:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d81a1b800): rc 0 00000020:00000080:0.0:1788851320.653064:0:21183:0:(genops.c:885:class_export_put()) final put ffff892d81a1b800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788851320.656255:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d875ea800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788851320.658734:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d81a1b800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788851320.670481:0:21183:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788851320.670490:0:21183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788851320.670494:0:21183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788851320.670501:0:21183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788851320.670759:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d85f3b800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788851320.670856:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851320.670866:0:21183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788851320.670871:0:21183:0:(genops.c:885:class_export_put()) final put ffff892d875e9800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788851320.670874:0:21183:0:(genops.c:844:class_export_destroy()) destroying export ffff892d875e9800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788851320.670884:0:21183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788851320.670950:0:21183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788851320.670954:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851320.670958:0:21183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788851320.670964:0:21183:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff892d81a1d800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788851320.670970:0:21183:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff892d87ac4d40) has exports, disconnecting them 00000020:00080000:2.0:1788851320.670975:0:21183:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff892d81a1d800), last request at 1788851243 00000020:00000080:2.0:1788851320.670979:0:21183:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206cc3 00000020:00080000:2.0:1788851320.670992:0:21183:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d81a1d800): rc 0 00000020:00000080:2.0:1788851320.670996:0:21183:0:(genops.c:885:class_export_put()) final put ffff892d81a1d800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788851320.671439:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892d81a1d800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788851320.672087:0:21183:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788851320.672092:0:21183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788851320.672095:0:21183:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788851320.672099:0:21183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788851320.672118:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d81a18800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788851320.672259:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788851320.672265:0:21183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788851320.672268:0:21183:0:(genops.c:885:class_export_put()) final put ffff892d81a19000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788851320.672271:0:21183:0:(genops.c:844:class_export_destroy()) destroying export ffff892d81a19000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788851320.672275:0:21183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788851320.672324:0:21183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892ea4305000 1 00000020:00000080:3.0:1788851320.672329:0:21183:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206c61 00000020:00000080:3.0:1788851320.672334:0:21183:0:(genops.c:885:class_export_put()) final put ffff892e83e2d800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788851320.672343:0:21183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788851320.672350:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e2d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788851320.672359:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788851320.672386:0:21183:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788851320.672389:0:21183:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff892e83e3b380) has no exports 00000020:00000080:3.0:1788851320.899315:0:21183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788851320.899332:0:21183:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788851320.899338:0:21183:0:(genops.c:885:class_export_put()) final put ffff892ea4307000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788851320.899343:0:21183:0:(genops.c:844:class_export_destroy()) destroying export ffff892ea4307000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788851320.899357:0:21183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788851320.899553:0:21183:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff892ea4306000 00000020:02000400:3.0:1788851320.899627:0:21183:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788851321.141791:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851322.166882:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851323.188242:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851324.214421:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788851324.512773:0:21384:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788851324.523007:0:21384:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788851324.523133:0:21384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851324.523149:0:21384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851324.523157:0:21384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851324.523164:0:21384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851324.523182:0:21384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788851324.523188:0:21384:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788851324.523213:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788851324.523225:0:21384:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892eb694ce00 x1875746019837696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788851339 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851324.523241:0:21384:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788851324.523247:0:21384:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788851324.523253:0:21384:0:(import.c:65:import_set_state_nolock()) ffff892d81a65800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788851324.523260:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788851324.523280:0:21384:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892eb694ce00 x1875746019837696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788851339 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851324.523287:0:21384:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788851324.523291:0:21384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1788851324.523415:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019837696:0@lo:38:kworker.0 00010000:00010000:0.0:1788851324.524153:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851324.524162:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851324.524171:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851324.524174:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851324.524182:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851324.524188:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851324.524193:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851324.524195:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788851324.524198:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788851324.524210:0:17200:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e983ab000 00010000:00010000:0.0:1788851324.524213:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851324.524219:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e80030400/0x3e0030720b206df7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206dfe expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851324.524231:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851324.524240:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851324.524242:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788851324.527191:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788851324.527207:0:21384:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892eb694df80 x1875746019837824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788851334 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851324.527232:0:21384:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788851324.527238:0:21384:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788851324.527244:0:21384:0:(import.c:65:import_set_state_nolock()) ffff892eb6996000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788851324.527251:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788851324.527255:0:21384:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892eb694df80 x1875746019837824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788851334 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851324.527263:0:21384:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788851324.527267:0:21384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:2.0:1788851324.527302:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875746019837824:0@lo:38:kworker.0 00010000:00010000:3.0:1788851324.531136:0:21384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851324.531158:0:21384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851324.531166:0:21384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851324.531173:0:21384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851324.531199:0:21384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851324.531206:0:21384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851324.531225:0:21384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851324.532077:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851324.532096:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851324.532104:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea55bc600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788851324.532108:0:17201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851324.532116:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788851324.532123:0:17201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851324.532129:0:17201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788851324.532132:0:17201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1788851324.532144:0:17201:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e983ab000 00010000:00010000:2.0:1788851324.532148:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851324.532154:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea55bc600/0x3e0030720b206dcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206dd4 expref: -99 pid: 19530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851324.532170:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851324.532172:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851324.532173:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851324.533174:0:21384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851324.533183:0:21384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851324.534395:0:21384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788851324.534407:0:21384:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788851324.534414:0:21384:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788851324.534458:0:21384:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788851324.534463:0:21384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788851324.534471:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788851324.534476:0:21384:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788851324.534481:0:21384:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff892e83e399c0) has no exports 00000020:00080000:3.0:1788851324.534515:0:21384:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff892e83e399c0) has no exports 00000020:01000000:3.0:1788851324.537077:0:21384:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892d85f5f4e0 - data ffff892d860716c0/ffff892ebbd53800 00000020:01000000:3.0:1788851324.539917:0:21384:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff892e86616e40 - data ffff892eb34116c0/ffff892d81b1b400 00010000:00010000:0.0:1788851324.540347:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851324.540357:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851324.540369:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebb200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851324.540373:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851324.540383:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851324.540390:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851324.540395:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788851324.540397:0:17200:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788851324.540400:0:17200:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788851324.540416:0:17200:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e983ab000 00010000:00010000:0.0:1788851324.540432:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851324.540439:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e9eebb200/0x3e0030720b206fc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206fcc expref: -99 pid: 17209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851324.540455:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851324.540456:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851324.540458:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788851324.565320:0:21384:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788851324.575778:0:21384:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206de2 00000020:00000080:1.0:1788851324.575798:0:21384:0:(genops.c:885:class_export_put()) final put ffff892eb6995000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788851324.575822:0:21384:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892d875ec800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788851324.575826:0:21384:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892d875ec800 2 00000020:01000004:1.0:1788851324.575829:0:21384:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff892d875ec800 from lustre-OST0001 00000020:00000080:1.0:1788851324.575856:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851324.575866:0:21384:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788851324.575870:0:21384:0:(genops.c:885:class_export_put()) final put ffff892eb6992000/lustre-OST0001_UUID 00000020:00000080:1.0:1788851324.575873:0:21384:0:(genops.c:844:class_export_destroy()) destroying export ffff892eb6992000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788851324.575880:0:21384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788851324.575966:0:21384:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6a8a82bd-f416-4736-bb65-b562856c988b->MGS 00010000:00010000:1.0:1788851324.575982:0:21384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9000/0x3e0030720b206b2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206b34 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851324.575993:0:21384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9000/0x3e0030720b206b2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206b34 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851324.575999:0:21384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788851324.576002:0:21384:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788851324.576005:0:21384:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788851324.576038:0:21384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e983ab000 00010000:00010000:1.0:1788851324.576042:0:21384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e8a8b9000/0x3e0030720b206b2d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206b34 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851324.576057:0:21384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851324.576063:0:21384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851324.576067:0:21384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788851324.576069:0:21384:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788851324.576071:0:21384:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788851324.576087:0:21384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff892e983ab000 00010000:00010000:1.0:1788851324.576090:0:21384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea55bd600/0x3e0030720b206a1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3e0030720b206a23 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788851324.576107:0:21384:0:(import.c:65:import_set_state_nolock()) ffff892e983ab000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788851324.576110:0:21384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788851324.576113:0:21384:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788851324.576114:0:21384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788851324.576118:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788851324.576127:0:21384:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff892ea590ca80 x1875746019836544/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788851324 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1788851324.576235:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892eb6995000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1788851324.576271:0:21384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788851324.576274:0:21384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1788851324.577163:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6a8a82bd-f416-4736-bb65-b562856c988b:3646:1875746019836544:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:1.0:1788851324.577242:0:21384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788851324.577252:0:21384:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206a07 00000020:00000080:1.0:1788851324.577259:0:21384:0:(genops.c:885:class_export_put()) final put ffff892e983ae000/6a8a82bd-f416-4736-bb65-b562856c988b 00000020:01000000:1.0:1788851324.577276:0:21384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.127@tcp (flags='') 00000020:00000080:1.0:1788851324.577281:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851324.577286:0:21384:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.127@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788851324.577290:0:21384:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff892d85f23380) has no exports 00000020:00000080:3.0:1788851324.577340:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892e983ae000/6a8a82bd-f416-4736-bb65-b562856c988b for MGC192.168.204.127@tcp 10000000:01000000:2.0:1788851324.577388:0:17209:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788851324.577672:0:21384:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.127@tcp: client import never connected 00000100:00080000:1.0:1788851324.577677:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788851324.577679:0:21384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788851324.577682:0:21384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788851324.577684:0:21384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788851324.577734:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851324.577739:0:21384:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.127@tcp (uuid 6a8a82bd-f416-4736-bb65-b562856c988b) 00000020:01000000:1.0:1788851324.577746:0:21384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788851324.577749:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851324.577753:0:21384:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788851324.577758:0:21384:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff892d81a64800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788851324.577763:0:21384:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff892d85c619c0) has exports, disconnecting them 00000020:00080000:1.0:1788851324.577777:0:21384:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff892d81a64800), last request at 1788851263 00000020:00000080:1.0:1788851324.577781:0:21384:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206e0c 00000020:00080000:1.0:1788851324.577794:0:21384:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892d81a64800): rc 0 00000020:00000080:1.0:1788851324.577797:0:21384:0:(genops.c:885:class_export_put()) final put ffff892d81a64800/lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788851324.578552:0:21384:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788851324.578557:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788851324.578560:0:21384:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788851324.578565:0:21384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788851324.578701:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851324.578706:0:21384:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788851324.578713:0:21384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788851324.578717:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851324.578721:0:21384:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788851324.578726:0:21384:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff892eb6991000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788851324.578731:0:21384:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff892e83e38000) has exports, disconnecting them 00000020:00080000:2.0:1788851324.578735:0:21384:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff892eb6991000), last request at 1788851263 00000020:00000080:2.0:1788851324.578738:0:21384:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206e21 00000020:00080000:2.0:1788851324.578751:0:21384:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff892eb6991000): rc 0 00000020:00000080:2.0:1788851324.578754:0:21384:0:(genops.c:885:class_export_put()) final put ffff892eb6991000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788851324.579513:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892e983ab000 for MGC192.168.204.127@tcp 00000020:00000080:3.0:1788851324.579523:0:8:0:(genops.c:885:class_export_put()) final put ffff892e983a8000/6a8a82bd-f416-4736-bb65-b562856c988b 00000020:00000080:3.0:1788851324.579526:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892e983a8000/6a8a82bd-f416-4736-bb65-b562856c988b for MGC192.168.204.127@tcp 00000020:01000000:3.0:1788851324.579532:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.127@tcp (6a8a82bd-f416-4736-bb65-b562856c988b) 00000020:00000080:3.0:1788851324.579774:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892d81a64800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788851324.579788:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892d81a65800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788851324.579793:0:8:0:(genops.c:885:class_export_put()) final put ffff892eb6cf3000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788851324.579796:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892eb6cf3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788851324.579799:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788851324.579829:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892eb6991000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788851324.583009:0:21384:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788851324.583031:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788851324.583035:0:21384:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788851324.583042:0:21384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788851324.583077:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff892eb6996000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788851324.585075:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788851324.601105:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1788851324.601345:0:17196:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff892ea55cc400:17196] 1 exiting: rc = 0 00000100:00100000:1.0:1788851324.601444:0:17195:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff892d85c3d800:17195] 0 exiting: rc = 1 00000100:00100000:3.0:1788851324.601816:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851324.602235:0:17197:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff892ea55cc600:17197] 0 exiting: rc = 1 00000100:00100000:3.0:1788851324.602315:0:17199:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff892ea55ccc00:17199] 2 exiting: rc = 0 00000100:00100000:2.0:1788851324.602505:0:18367:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff892e856f0c00:18367] 3 exiting: rc = 0 00000100:00100000:0.0:1788851324.602752:0:17198:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff892ea55cd600:17198] 1 exiting: rc = 0 00000100:00100000:3.0:1788851324.602959:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.602968:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.602975:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.602981:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.602987:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.602994:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.603000:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.603005:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606107:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606121:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606128:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606133:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606138:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606143:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606149:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606154:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606159:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606182:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606188:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606193:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606199:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606203:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606208:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606214:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606219:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606224:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606229:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606234:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606239:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606244:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606249:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606255:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606259:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606265:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606269:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606274:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606279:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606285:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606290:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606295:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606301:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606306:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606311:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606316:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606321:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606326:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606331:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606337:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606341:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606346:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606351:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606356:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606369:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606374:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606379:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606384:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606390:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606396:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606402:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606407:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606412:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606509:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606518:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.606625:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788851324.612708:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788851324.612721:0:21384:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788851324.612728:0:21384:0:(genops.c:885:class_export_put()) final put ffff892eb6990800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788851324.612733:0:21384:0:(genops.c:844:class_export_destroy()) destroying export ffff892eb6990800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788851324.612738:0:21384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788851324.612790:0:21384:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892d875ec800 1 00000020:00000080:3.0:1788851324.612796:0:21384:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x3e0030720b206dc6 00000020:00000080:3.0:1788851324.612802:0:21384:0:(genops.c:885:class_export_put()) final put ffff892eacd5e000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788851324.612827:0:21384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788851324.612831:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788851324.612836:0:21384:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788851324.612840:0:21384:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff892d85c64d40) has no exports 00000020:00000080:2.0:1788851324.615973:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff892eacd5e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788851324.674739:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851324.674752:0:21384:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788851324.674758:0:21384:0:(genops.c:885:class_export_put()) final put ffff892d875ef000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788851324.674763:0:21384:0:(genops.c:844:class_export_destroy()) destroying export ffff892d875ef000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788851324.674774:0:21384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788851324.675293:0:21384:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff892d875ee000 00000020:01000000:2.0:1788851324.675316:0:21384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788851324.675321:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851324.675326:0:21384:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788851324.675330:0:21384:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff892d87ac3380) has no exports 00000020:00000080:2.0:1788851324.675359:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851324.675364:0:21384:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788851324.675368:0:21384:0:(genops.c:885:class_export_put()) final put ffff892e83e2a800/OSS_uuid 00000020:00000080:2.0:1788851324.675370:0:21384:0:(genops.c:844:class_export_destroy()) destroying export ffff892e83e2a800/OSS_uuid for OSS 00000020:01000000:2.0:1788851324.675373:0:21384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788851324.675641:0:17208:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788851324.675830:0:19145:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff892d87423e00:19145] 3 exiting: rc = 0 00000100:00100000:3.0:1788851324.675975:0:18719:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff892e89810c00:18719] 0 exiting: rc = 1 00000100:00100000:3.0:1788851324.676181:0:18720:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff892e9092d400:18720] 1 exiting: rc = 0 00000100:00100000:1.0:1788851324.676267:0:18721:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff892d883e2a00:18721] 2 exiting: rc = 0 00000100:00100000:2.0:1788851324.676379:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676387:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676392:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676398:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676403:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676408:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676414:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676501:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676507:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676513:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676518:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676523:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676528:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676532:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676537:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676542:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676547:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676553:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676558:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676564:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676570:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676575:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676580:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676586:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676591:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676596:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676602:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676608:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676614:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676619:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676634:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676639:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676645:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676651:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676656:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676662:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676668:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676673:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676678:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676683:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676689:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676694:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676700:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676706:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676712:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676717:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676722:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676728:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676734:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676738:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676743:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676927:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676937:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676943:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676950:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676956:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676961:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676965:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676971:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676977:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676982:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676988:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.676994:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.677000:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851324.678451:0:18723:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff892eb6e66000:18723] 1 exiting: rc = 0 00000100:00100000:0.0:1788851324.678657:0:18722:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff892eb6e66a00:18722] 0 exiting: rc = 1 00000100:00100000:3.0:1788851324.678815:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678822:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678827:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678832:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678837:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678842:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678848:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678865:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678870:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678875:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678881:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678886:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678891:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678896:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678902:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678907:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678912:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678917:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678923:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678928:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678934:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678940:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678945:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678951:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678956:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678961:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678966:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678971:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678976:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678981:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678987:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678993:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.678998:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679003:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679008:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679389:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679395:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679400:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679406:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679411:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679481:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679500:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679513:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679518:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679523:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679528:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679533:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679538:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679544:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679550:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679555:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679560:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679565:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679571:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679576:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679582:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679587:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679592:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679597:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679603:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679609:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679614:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679619:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.679625:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.681111:0:20350:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_003: service thread [ffff892eb69d5a00:20350] 3 exiting: rc = 0 00000100:00100000:1.0:1788851324.681523:0:18725:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff892ea3c8e400:18725] 1 exiting: rc = 0 00000100:00100000:0.0:1788851324.681711:0:18724:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff892ea3c8e200:18724] 0 exiting: rc = 1 00000100:00100000:0.0:1788851324.681854:0:18726:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff892ea3c8fa00:18726] 2 exiting: rc = 0 00000100:00100000:3.0:1788851324.681987:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682000:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682007:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682287:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682294:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682300:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682305:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682311:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682316:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682322:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682346:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682354:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682359:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682373:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682380:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682386:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682392:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682397:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682403:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682409:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682751:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682764:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682770:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682776:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682783:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682789:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682796:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682802:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682808:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682814:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682820:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682827:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682834:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682840:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682861:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682869:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682876:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682883:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682889:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682895:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682901:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682907:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682913:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682919:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682925:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682930:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682936:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682942:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682957:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682963:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682970:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682976:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682982:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.682989:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.683002:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.683009:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.683106:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.683114:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.683120:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.683126:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.683132:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.683139:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.683145:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.683159:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.687371:0:18727:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff892e8a55e000:18727] 0 exiting: rc = 1 00000100:00100000:1.0:1788851324.687571:0:18728:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff892e8a55ea00:18728] 1 exiting: rc = 0 00000100:00100000:3.0:1788851324.687654:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687661:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687666:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687671:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687676:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687681:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687686:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687690:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687702:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687709:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687715:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687720:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687725:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687731:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687736:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687741:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687745:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687750:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687754:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687772:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687777:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687782:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687787:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687792:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687797:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687803:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687807:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687812:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687817:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687823:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687827:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687833:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687838:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687843:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687847:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687852:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687856:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687861:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687866:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687870:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687875:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687880:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687884:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687889:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687893:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687898:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687902:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687908:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687913:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687918:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687923:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687927:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687932:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687936:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687949:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687954:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687960:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687964:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687969:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687975:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687980:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687985:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687990:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.687995:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851324.692721:0:18729:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff892ea5701400:18729] 0 exiting: rc = 1 00000100:00100000:2.0:1788851324.694140:0:18730:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff892ea5700400:18730] 1 exiting: rc = 0 00000100:00100000:3.0:1788851324.694297:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694307:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694312:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694317:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694324:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694330:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694336:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694342:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694348:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694372:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694380:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694386:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694394:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694401:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694408:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694415:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694510:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694516:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694523:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694529:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694536:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694559:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694567:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694573:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694579:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694599:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694605:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694610:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694616:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694622:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694628:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694634:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694641:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694662:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694670:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694676:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694682:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694688:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694694:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694700:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694706:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694712:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694718:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694724:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694729:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694749:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694756:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694761:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694768:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694774:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694779:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694785:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694792:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694798:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694803:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694809:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694814:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694834:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694841:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694848:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694861:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694870:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694876:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851324.694889:0:21384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788851324.714845:0:21384:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788851345.556419:0:22149:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788851356.497401:0:22748:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788851356.497409:0:22748:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788851356.497410:0:22748:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788851356.497589:0:22748:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff892d89078800 00000020:01000004:3.0:1788851356.497609:0:22748:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788851356.497617:0:22748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788851356.497633:0:22748:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff892ead6d99c0) 00000020:00000080:3.0:1788851356.497648:0:22748:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788851356.616692:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788851356.616995:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.623369:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788851356.634185:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.634888:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.635206:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.636548:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.637493:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.642559:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.643546:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.644304:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.649540:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.650460:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.650825:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.652938:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.653858:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.654234:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.654821:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.655462:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.656460:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.658278:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.659491:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.659989:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.660570:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.661924:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.663564:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.664911:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.665340:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.665822:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.666119:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.666520:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.667475:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788851356.667911:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.668447:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788851356.668719:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788851356.678225:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788851356.678928:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788851356.679209:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788851356.679885:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788851356.680553:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788851356.680933:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788851356.681176:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788851356.681697:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788851356.683298:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788851356.683838:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788851356.685570:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788851356.686227:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788851356.692706:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788851356.693966:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788851356.694397:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788851356.695697:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788851356.696538:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788851356.697090:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:0.0:1788851356.711887:0:22748:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788851356.712212:0:22748:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788851356.712223:0:22748:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788851356.712236:0:22748:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b207273 00000020:01000004:0.0:1788851356.712244:0:22748:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788851356.712250:0:22748:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788851356.712255:0:22748:0:(tgt_mount.c:101:server_register_mount()) register mount ffff892d89078800 from MGS 00000020:01000004:0.0:1788851356.712259:0:22748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788851356.712269:0:22748:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff892e83e3cd40) 00000020:00000080:0.0:1788851356.712280:0:22748:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788851356.714408:0:22748:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892d89078800 from MGS, refs=2 00080000:01000000:0.0:1788851356.714423:0:22748:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788851356.714434:0:22748:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b207281 00000100:00100000:0.0:1788851356.714572:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788851356.714703:0:22748:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788851356.714710:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788851356.730437:0:22748:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788851356.730456:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788851356.733472:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788851356.733681:0:22748:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788851356.733687:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788851356.741560:0:22748:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788851356.741580:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788851356.742193:0:22748:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788851356.742201:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788851356.744264:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851356.744270:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851356.744273:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851356.745250:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851356.745254:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851356.745256:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851356.746178:0:22748:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788851356.749089:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788851356.764675:0:22748:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788851356.769970:0:22760:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788851356.770069:0:22748:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788851356.770133:0:22748:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788851356.771806:0:22748:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788851356.772236:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788851356.772602:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788851356.772609:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788851356.789367:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788851356.789387:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788851356.789637:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788851356.789644:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788851356.791160:0:22748:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788851356.791181:0:22748:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.127@tcp' 00000020:01000004:3.0:1788851356.791183:0:22748:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788851356.791214:0:22748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.127@tcp (typ=mgc) 00000020:00000080:3.0:1788851356.791227:0:22748:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.127@tcp (ffff892ead6d8000) 00000020:00000080:3.0:1788851356.791243:0:22748:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788851356.791465:0:22748:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892eb696d800@MGC192.168.204.127@tcp: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1788851356.791659:0:22748:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.127@tcp-0 is initialized 00000040:01000000:3.0:1788851356.791667:0:22748:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788851356.791833:0:22765:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788851356.805910:0:22766:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788851356.806476:0:22748:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.127@tcp (uuid dc4a524f-5762-4d21-be7e-dbb6f41ca491) 00000020:00000080:2.0:1788851356.806506:0:22748:0:(genops.c:1384:class_connect()) connect: client dc4a524f-5762-4d21-be7e-dbb6f41ca491, cookie 0x3e0030720b20728f 00000100:00080000:2.0:1788851356.806520:0:22748:0:(import.c:545:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788851356.806532:0:22748:0:(import.c:666:import_select_connection()) MGC192.168.204.127@tcp: import ffff892eb696d800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851356.806569:0:22748:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea590c380 x1875746019837952/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851356.806641:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3646:1875746019837952:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788851356.806710:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851356.806829:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019837952 00000100:00100000:0.0:1788851356.806838:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019837952 00000100:00100000:0.0:1788851356.806886:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851356.806894:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1875746019837952:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788851356.806920:0:22761:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from dc4a524f-5762-4d21-be7e-dbb6f41ca491@0@lo t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:0.0:1788851356.806945:0:22761:0:(genops.c:1384:class_connect()) connect: client dc4a524f-5762-4d21-be7e-dbb6f41ca491, cookie 0x3e0030720b207296 00000100:00080000:0.0:1788851356.807124:0:22761:0:(import.c:65:import_set_state_nolock()) ffff892d89302800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788851356.807289:0:22748:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import dc4a524f-5762-4d21-be7e-dbb6f41ca491->MGS 00000020:01000004:2.0:1788851356.807310:0:22748:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788851356.807345:0:22748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788851356.807360:0:22748:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff892d85c64d40) 00000020:00000080:2.0:1788851356.807370:0:22748:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788851356.812511:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+5:3646:x1875746019837952:12345-0@lo:250:mount.lustre.0 Request processed in 5602us (5786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851356.812528:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788851356.815676:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788851356.815692:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.127@tcp: connect to target with instance 0 00000100:00080000:3.0:1788851356.815702:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788851356.815708:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788851356.815712:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eb696d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788851356.815716:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788851356.815790:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788851356.815800:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3646:1875746019837952:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788851356.826094:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788851356.826301:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788851356.826308:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788851356.830137:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788851356.830149:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788851356.831670:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788851356.831681:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788851356.832717:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788851356.832940:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788851356.832945:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788851356.834194:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788851356.834203:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788851356.875637:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788851356.875886:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788851356.875893:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788851356.882971:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788851356.885537:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788851356.888090:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788851356.888301:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788851356.888309:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788851356.889419:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788851356.889429:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788851356.891161:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788851356.891546:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788851356.891553:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788851356.895918:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788851356.895937:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788851356.899154:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788851356.899354:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788851356.899361:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788851356.901753:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788851356.901767:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788851356.941532:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788851356.944456:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788851356.944473:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788851356.946481:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788851356.946498:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788851356.947414:0:22748:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788851356.947424:0:22748:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788851356.948240:0:22748:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788851356.948272:0:22748:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788851356.948280:0:22748:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788851356.948392:0:22748:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788851356.948424:0:22748:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788851356.948429:0:22748:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788851356.948431:0:22748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788851356.948432:0:22748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851356.948437:0:22748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851356.948438:0:22748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851356.948439:0:22748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851356.948441:0:22748:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788851356.948442:0:22748:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788851356.948444:0:22748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851356.948445:0:22748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788851356.948447:0:22748:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788851356.948450:0:22748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788851356.948451:0:22748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788851356.948452:0:22748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851356.948453:0:22748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851356.948454:0:22748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851356.948455:0:22748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851356.948456:0:22748:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788851356.948457:0:22748:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788851356.948458:0:22748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851356.948459:0:22748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788851356.948493:0:22748:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788851356.948514:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838080:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788851356.948605:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851356.948651:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90039a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788851356.948897:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019838080 00000100:00100000:3.0:1788851356.948907:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019838080 00000100:00100000:3.0:1788851356.948958:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851356.948969:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+5:22748:x1875746019838080:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788851356.949049:0:22764:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788851356.949053:0:22764:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788851356.949056:0:22764:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788851356.952125:0:22785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788851356.953137:0:22764:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1788851356.955208:0:22786:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788851356.955215:0:22786:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788851356.955218:0:22786:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788851356.955221:0:22786:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788851356.955468:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788851356.960458:0:22764:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788851356.960475:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788851356.963293:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+5:22748:x1875746019838080:12345-0@lo:253:mount.lustre.0 Request processed in 14315us (14676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851356.963309:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851356.963582:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838080:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788851356.963601:0:22748:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788851356.963605:0:22748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788851356.963607:0:22748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788851356.963609:0:22748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851356.963610:0:22748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851356.963611:0:22748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851356.963613:0:22748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851356.963614:0:22748:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788851356.963615:0:22748:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788851356.963617:0:22748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851356.963618:0:22748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788851356.963640:0:22748:0:(tgt_mount.c:101:server_register_mount()) register mount ffff892d89078800 from lustre-MDT0000 10000000:01000000:2.0:1788851356.963678:0:22748:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788851356.963692:0:22748:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788851356.963697:0:22748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff892ead6d8000 10000000:01000000:2.0:1788851356.963702:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788851356.963710:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff892ead6d8000 from 1 10000000:01000000:2.0:1788851356.963713:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788851356.963755:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851356.963767:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851356.963778:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851356.963810:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788851356.963850:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851356.963894:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90039c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851356.963972:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019838208 00000100:00100000:3.0:1788851356.963980:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019838208 00000100:00100000:3.0:1788851356.964080:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788851356.964090:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+5:22748:x1875746019838208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851356.964110:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851356.964126:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433d200/0x3e0030720b2072ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2072a4 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851356.964152:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433d200/0x3e0030720b2072ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2072a4 expref: 6 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851356.964164:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433d200/0x3e0030720b2072ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2072a4 expref: 6 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851356.964174:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d200, rc 0) 00000100:00100000:3.0:1788851356.964215:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+6:22748:x1875746019838208:12345-0@lo:101:mount.lustre.0 Request processed in 127us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851356.964221:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788851356.964256:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851356.964271:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851356.964281:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851356.964331:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851356.964356:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851356.964385:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90039c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851356.964448:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019838336 00000100:00100000:3.0:1788851356.964453:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019838336 00000100:00100000:3.0:1788851356.964474:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788851356.964480:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+6:22748:x1875746019838336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851356.964582:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+6:22748:x1875746019838336:12345-0@lo:501:mount.lustre.0 Request processed in 102us (225us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788851356.964590:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788851356.964768:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838336:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788851356.964797:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788851356.964823:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851356.964833:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851356.964841:0:22748:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff892d89078800 10000000:01000000:2.0:1788851356.964847:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788851356.964851:0:22748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff892d89078800 10000000:01000000:2.0:1788851356.964854:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788851356.964857:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff892d89078800 from 1 10000000:01000000:2.0:1788851356.964869:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788851356.964889:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94400/0x3e0030720b2072b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851356.964897:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff94400/0x3e0030720b2072b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851356.964906:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff94400/0x3e0030720b2072b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851356.964921:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788851356.964950:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851356.964971:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90039c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851356.964991:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019838464 00000100:00100000:3.0:1788851356.964995:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019838464 00000100:00100000:3.0:1788851356.965040:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788851356.965047:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+6:22748:x1875746019838464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851356.965055:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851356.965065:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433da00/0x3e0030720b2072b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2072b2 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851356.965093:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433da00/0x3e0030720b2072b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2072b2 expref: 7 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851356.965101:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433da00/0x3e0030720b2072b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2072b2 expref: 7 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851356.965110:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433da00, rc 0) 00000100:00100000:3.0:1788851356.965136:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+7:22748:x1875746019838464:12345-0@lo:101:mount.lustre.0 Request processed in 90us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851356.965143:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788851356.965154:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851356.965165:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff94400/0x3e0030720b2072b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072b9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851356.965173:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff94400/0x3e0030720b2072b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2072b9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851356.965191:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788851356.965207:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94400/0x3e0030720b2072b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072b9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851356.965214:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff94400/0x3e0030720b2072b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072b9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851356.965220:0:22748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788851356.965223:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788851356.965228:0:22748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff892d89078800 10000000:01000000:2.0:1788851356.965230:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788851356.965233:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788851356.965235:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788851356.965250:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b2072c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851356.965257:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b2072c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851356.965264:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b2072c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851356.965276:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788851356.965301:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851356.965342:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90039c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851356.967119:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019838592 00000100:00100000:3.0:1788851356.967134:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019838592 00000100:00100000:3.0:1788851356.967202:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851356.967211:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+7:22748:x1875746019838592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851356.967226:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851356.967244:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433d400/0x3e0030720b2072c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2072c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851356.967270:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433d400/0x3e0030720b2072c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2072c0 expref: 8 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851356.967281:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433d400/0x3e0030720b2072c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2072c0 expref: 8 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851356.967290:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d400, rc 0) 00000100:00100000:3.0:1788851356.967369:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+8:22748:x1875746019838592:12345-0@lo:101:mount.lustre.0 Request processed in 159us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851356.967375:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788851356.967478:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851356.967496:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b2072c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072c7 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851356.967512:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b2072c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2072c7 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851356.967584:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851356.967625:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851356.967659:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90039c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851356.967930:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019838720 00000100:00100000:3.0:1788851356.967935:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019838720 00000100:00100000:3.0:1788851356.967966:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851356.967973:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+8:22748:x1875746019838720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851356.968152:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+9:22748:x1875746019838720:12345-0@lo:501:mount.lustre.0 Request processed in 178us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851356.968169:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788851356.968421:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851356.968452:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851356.968495:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851356.968519:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90039c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851356.968542:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019838848 00000100:00100000:3.0:1788851356.968548:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019838848 00000100:00100000:3.0:1788851356.968579:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851356.968585:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+9:22748:x1875746019838848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851356.969307:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+9:22748:x1875746019838848:12345-0@lo:503:mount.lustre.0 Request processed in 720us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851356.969316:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788851356.969415:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019838848:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851356.969945:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22787:1875746019838976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851356.969987:0:22787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851356.970060:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90d61cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851356.970367:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019838976 00000100:00100000:3.0:1788851356.970373:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019838976 00000100:00100000:3.0:1788851356.970412:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788851356.970421:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+9:22787:x1875746019838976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851356.972551:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+9:22787:x1875746019838976:12345-0@lo:502:llog_process_th.0 Request processed in 2122us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851356.972565:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851356.972770:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22787:1875746019838976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788851356.972833:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851356.972848:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851356.972851:0:22787:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788851356.972868:0:22787:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788851356.972871:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788851356.972891:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff892eb6f43380) 00000020:00000080:1.0:1788851356.972913:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788851356.972919:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788851356.976978:0:22787:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788851356.977001:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b2072d5 00000020:00000080:0.0:1788851356.977342:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788851356.977355:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851356.977360:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851356.977363:0:22787:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788851356.977366:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851356.977373:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851356.977375:0:22787:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788851356.977379:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788851356.977395:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff892e83e38000) 00000020:00000080:0.0:1788851356.977413:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788851356.977419:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788851356.977421:0:22787:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788851356.977424:0:22787:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788851356.977432:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788851356.977507:0:22787:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892d89078800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788851356.977520:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff892e83e399c0) 00000020:00000080:0.0:1788851356.977528:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788851356.977603:0:22787:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788851356.977609:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b2072ea 00000020:00000080:0.0:1788851356.977705:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788851356.977711:0:22787:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788851356.977910:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3e0030720b2072f1 00080000:01000000:0.0:1788851356.977919:0:22787:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788851356.977924:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b2072f8 00010000:00010000:3.0:1788851357.061547:0:22787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788851357.062471:0:22787:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1788851357.062945:0:22787:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788851357.063741:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff892ead6dcd40) 00000020:00000080:3.0:1788851357.063764:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788851357.063882:0:22787:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788851357.063896:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b207306 00000020:00000080:3.0:1788851357.064516:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788851357.070063:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3e0030720b20730d 00000020:00000080:2.0:1788851357.074733:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788851357.074747:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851357.074756:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.074758:0:22787:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788851357.074761:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788851357.074764:0:22787:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788851357.074766:0:22787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788851357.074768:0:22787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788851357.074770:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788851357.074772:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.074774:0:22787:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788851357.074776:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851357.074782:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.074783:0:22787:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788851357.074788:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788851357.074855:0:22787:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788851357.074887:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851357.074897:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.074898:0:22787:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788851357.074902:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851357.074905:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.074907:0:22787:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788851357.074909:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788851357.074915:0:22787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:2.0:1788851357.074940:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788851357.074955:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff892d85c60000) 00000020:00000080:2.0:1788851357.074973:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788851357.074978:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788851357.075060:0:22787:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788851357.075065:0:22787:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788851357.075077:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b20731b 00010000:00080000:2.0:1788851357.075110:0:22787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892e91592800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1788851357.078498:0:22787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788851357.079973:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851357.079990:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788851357.080151:0:22787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788851357.080180:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b207322 00000100:00080000:0.0:1788851357.080191:0:22787:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788851357.080203:0:22787:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff892e91592800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851357.080240:0:22787:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892eb694ed80 x1875746019839104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851357.080322:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019839104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788851357.080392:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851357.080493:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019839104 00000100:00100000:2.0:1788851357.080501:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019839104 00000100:00100000:2.0:1788851357.080541:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788851357.080548:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019839104:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788851357.080563:0:22774:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788851357.083642:0:22787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788851357.083797:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851357.083805:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851357.083807:0:22787:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788851357.083812:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788851357.083814:0:22787:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788851357.083816:0:22787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788851357.083818:0:22787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788851357.083819:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788851357.083822:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851357.083824:0:22787:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788851357.083826:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788851357.083833:0:22787:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788851357.083836:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851357.083837:0:22787:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788851357.083841:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788851357.083844:0:22787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:0.0:1788851357.083883:0:22787:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788851357.083885:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788851357.083902:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff892e83e3b380) 00000020:00000080:0.0:1788851357.083925:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788851357.083930:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788851357.084046:0:22787:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788851357.084052:0:22787:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788851357.084060:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b207330 00010000:00080000:0.0:1788851357.084095:0:22787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d85c57800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1788851357.084538:0:22787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788851357.087907:0:22787:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788851357.088438:0:22787:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788851357.096442:0:22787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788851357.097503:0:22787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:2.0:1788851357.110154:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019839104:12345-0@lo:38:llog_process_th.0 Request processed in 29597us (29753us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851357.110169:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788851357.110534:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e91592800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851357.110542:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788851357.110547:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019839104:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788851357.112271:0:22787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1788851357.113005:0:22794:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788851357.113044:0:22794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788851357.113930:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851357.113946:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788851357.113991:0:22787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788851357.114055:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b207337 00000100:00080000:0.0:1788851357.114070:0:22787:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788851357.114082:0:22787:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff892d85c57800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851357.114124:0:22787:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892eb694d880 x1875746019839232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851357.114153:0:22787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788851357.114211:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851357.114215:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851357.114217:0:22787:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788851357.114221:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788851357.114223:0:22787:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788851357.114225:0:22787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788851357.114227:0:22787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788851357.114228:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788851357.114231:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851357.114232:0:22787:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788851357.114235:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788851357.114240:0:22787:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788851357.114243:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851357.114244:0:22787:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788851357.114247:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788851357.114251:0:22787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:0.0:1788851357.114276:0:22787:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788851357.114278:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788851357.114290:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff892d874a3380) 00000020:00000080:0.0:1788851357.114302:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788851357.114545:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788851357.114608:0:22787:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788851357.114617:0:22787:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788851357.114623:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e0030720b207345 00010000:00080000:0.0:1788851357.114655:0:22787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892eb6998800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1788851357.115114:0:22787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788851357.115187:0:22787:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788851357.115204:0:22787:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788851357.115442:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019839232:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788851357.115500:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019839232 offset 0 length 520: 4 00000040:00080000:0.0:1788851357.117475:0:22787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851357.117684:0:22787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788851357.118306:0:22787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788851357.118767:0:22796:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788851357.118772:0:22796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788851357.120243:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851357.120262:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788851357.120391:0:22787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788851357.120413:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b20734c 00000100:00080000:0.0:1788851357.120423:0:22787:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788851357.120434:0:22787:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff892eb6998800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851357.120476:0:22787:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892eb694f480 x1875746019839360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788851357.120542:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019839360:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788851357.120616:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019839360 offset 0 length 520: 4 00000100:00080000:0.0:1788851357.120682:0:22787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788851357.120757:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851357.120763:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851357.120765:0:22787:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788851357.120768:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851357.120772:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851357.120773:0:22787:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788851357.120776:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788851357.120779:0:22787:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788851357.120781:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851357.120783:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851357.120784:0:22787:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788851357.120804:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851357.120807:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851357.120809:0:22787:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788851357.120813:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788851357.120843:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22787:1875746019839488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851357.120907:0:22787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851357.120922:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8146ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851357.121177:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019839488 00000100:00100000:3.0:1788851357.121185:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019839488 00000100:00100000:3.0:1788851357.121232:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788851357.121242:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+9:22787:x1875746019839488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851357.121387:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+9:22787:x1875746019839488:12345-0@lo:502:llog_process_th.0 Request processed in 145us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851357.121395:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851357.121604:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22787:1875746019839488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788851357.121636:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851357.121642:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851357.121644:0:22787:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788851357.121648:0:22787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788851357.121948:0:22748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788851357.121969:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788851357.121989:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b2072c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072c7 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.122001:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff95400/0x3e0030720b2072c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072c7 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851357.122009:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892d89078800 from 1 10000000:01000000:3.0:1788851357.122083:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788851357.122117:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.122139:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.122148:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851357.122164:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88398000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019839616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788851357.122201:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851357.122323:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead29fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851357.122983:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019839616 00000100:00100000:1.0:1788851357.122990:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019839616 00000100:00100000:0.0:1788851357.123294:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788851357.123305:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+9:22748:x1875746019839616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851357.123329:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851357.123346:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebbdab800/0x3e0030720b20735a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207353 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.123371:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebbdab800/0x3e0030720b20735a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207353 expref: 10 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.123382:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebbdab800/0x3e0030720b20735a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207353 expref: 10 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.123391:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdab800, rc 0) 00000100:00100000:0.0:1788851357.123453:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+10:22748:x1875746019839616:12345-0@lo:101:mount.lustre.0 Request processed in 151us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851357.123461:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788851357.123533:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88398000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019839616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851357.123548:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20735a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851357.123557:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20735a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851357.124171:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019839744:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788851357.124215:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851357.124665:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788851357.124813:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019839744 00000100:00100000:3.0:1788851357.124819:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019839744 00000100:00100000:3.0:1788851357.124852:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788851357.124871:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+10:22748:x1875746019839744:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788851357.124888:0:22761:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788851357.124894:0:22761:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788851357.124974:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+10:22748:x1875746019839744:12345-0@lo:256:mount.lustre.0 Request processed in 104us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851357.124981:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788851357.125141:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019839744:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788851357.125698:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788851357.125776:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20735a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851357.125796:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20735a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851357.125804:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892d89078800 from 1 10000000:01000000:2.0:1788851357.125807:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788851357.125834:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851357.125842:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851357.125851:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851357.125938:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019839872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788851357.125973:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851357.125998:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788851357.126685:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019839872 00000100:00100000:3.0:1788851357.126692:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019839872 00000100:00100000:3.0:1788851357.126874:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788851357.126884:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+10:22748:x1875746019839872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851357.126898:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851357.126913:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433de00/0x3e0030720b207368 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207361 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.126936:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433de00/0x3e0030720b207368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207361 expref: 11 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.126956:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433de00/0x3e0030720b207368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207361 expref: 11 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.126965:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433de00, rc 0) 00000100:00100000:3.0:1788851357.127031:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+11:22748:x1875746019839872:12345-0@lo:101:mount.lustre.0 Request processed in 129us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851357.127038:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851357.127209:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019839872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851357.127224:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207368 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851357.127233:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b207368 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851357.127293:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019840000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851357.127338:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851357.127358:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788851357.127505:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019840000 00000100:00100000:0.0:1788851357.127518:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019840000 00000100:00100000:0.0:1788851357.127542:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788851357.127549:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+11:22748:x1875746019840000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851357.127708:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+11:22748:x1875746019840000:12345-0@lo:501:mount.lustre.0 Request processed in 160us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851357.127725:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788851357.127911:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019840000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851357.127943:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019840128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851357.127988:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851357.128054:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788851357.128121:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019840128 00000100:00100000:3.0:1788851357.128125:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019840128 00000100:00100000:3.0:1788851357.128148:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788851357.128154:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+11:22748:x1875746019840128:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851357.128255:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+11:22748:x1875746019840128:12345-0@lo:503:mount.lustre.0 Request processed in 101us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851357.128262:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788851357.128414:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019840128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851357.129344:0:22798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22798:1875746019840256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851357.129397:0:22798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851357.129432:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788851357.129544:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019840256 00000100:00100000:3.0:1788851357.129551:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019840256 00000100:00100000:3.0:1788851357.129584:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788851357.129592:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+11:22798:x1875746019840256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851357.130177:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+11:22798:x1875746019840256:12345-0@lo:502:llog_process_th.0 Request processed in 585us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851357.130186:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788851357.130368:0:22798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22798:1875746019840256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788851357.130396:0:22798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851357.130412:0:22798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.130415:0:22798:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788851357.130423:0:22798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892d89078800 00000020:00000080:2.0:1788851357.130425:0:22798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851357.130434:0:22798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851357.130436:0:22798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.130438:0:22798:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788851357.130440:0:22798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851357.130442:0:22798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.130443:0:22798:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788851357.130447:0:22798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892d89078800 00000020:00000080:2.0:1788851357.130449:0:22798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851357.130503:0:22798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851357.130508:0:22798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.130509:0:22798:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788851357.130511:0:22798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851357.130514:0:22798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.130515:0:22798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788851357.130519:0:22798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892d89078800 00000020:00000080:2.0:1788851357.130521:0:22798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851357.130538:0:22798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851357.130540:0:22798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.130542:0:22798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788851357.130544:0:22798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851357.130547:0:22798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.130548:0:22798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788851357.130551:0:22798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892d89078800 00000020:00000080:2.0:1788851357.130553:0:22798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788851357.130588:0:22798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22798:1875746019840384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851357.130628:0:22798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851357.130665:0:22798:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea58ab6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851357.131184:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019840384 00000100:00100000:0.0:1788851357.131192:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019840384 00000100:00100000:0.0:1788851357.131226:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788851357.131233:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+11:22798:x1875746019840384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851357.131347:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+11:22798:x1875746019840384:12345-0@lo:502:llog_process_th.0 Request processed in 114us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851357.131354:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788851357.131491:0:22798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22798:1875746019840384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788851357.131521:0:22798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851357.131527:0:22798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851357.131529:0:22798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788851357.131533:0:22798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788851357.132982:0:22748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788851357.133028:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788851357.133044:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207368 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.133056:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207368 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851357.133108:0:22748:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788851357.133111:0:22748:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff892d89078800 10000000:01000000:0.0:1788851357.133114:0:22748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff892d89078800 10000000:01000000:0.0:1788851357.133119:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788851357.133125:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892d89078800 from 1 10000000:01000000:0.0:1788851357.133128:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788851357.133162:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdaba00/0x3e0030720b20736f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.133176:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebbdaba00/0x3e0030720b20736f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.133188:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebbdaba00/0x3e0030720b20736f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851357.133207:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019840512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788851357.133261:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851357.133297:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89afb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788851357.133335:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019840512 00000100:00100000:0.0:1788851357.133341:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019840512 00000100:00100000:0.0:1788851357.133377:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788851357.133385:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+11:22748:x1875746019840512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851357.133397:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851357.133408:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebbdaa000/0x3e0030720b207376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20736f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.133434:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebbdaa000/0x3e0030720b207376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20736f expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.133446:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebbdaa000/0x3e0030720b207376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20736f expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.133455:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdaa000, rc 0) 00000100:00100000:0.0:1788851357.133490:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22748:x1875746019840512:12345-0@lo:101:mount.lustre.0 Request processed in 105us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851357.133497:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788851357.133553:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019840512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851357.133568:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebbdaba00/0x3e0030720b20736f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207376 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.133578:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebbdaba00/0x3e0030720b20736f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b207376 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851357.133626:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019840640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851357.133649:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851357.133662:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89afb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788851357.133674:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019840640 00000100:00100000:0.0:1788851357.133678:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019840640 00000100:00100000:0.0:1788851357.133699:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788851357.133705:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e89049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22748:x1875746019840640:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851357.135061:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e89049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22748:x1875746019840640:12345-0@lo:501:mount.lustre.0 Request processed in 1352us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851357.135073:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788851357.135670:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019840640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851357.135873:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019840768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851357.135934:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851357.135970:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84a3d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788851357.136103:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019840768 00000100:00100000:0.0:1788851357.136110:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019840768 00000100:00100000:0.0:1788851357.136146:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788851357.136153:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8904b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22748:x1875746019840768:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788851357.136256:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8904b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22748:x1875746019840768:12345-0@lo:503:mount.lustre.0 Request processed in 103us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851357.136264:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788851357.136439:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019840768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851357.144579:0:22800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22800:1875746019840896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851357.144663:0:22800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851357.145489:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019840896 00000100:00100000:2.0:1788851357.145498:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019840896 00000100:00100000:2.0:1788851357.145545:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788851357.145555:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e89048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22800:x1875746019840896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851357.145678:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e89048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22800:x1875746019840896:12345-0@lo:502:llog_process_th.0 Request processed in 123us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851357.145685:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788851357.146447:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90d616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851357.146477:0:22800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22800:1875746019840896:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788851357.146557:0:22800:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788851357.146572:0:22800:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff892d874a4d40) 00000020:00000080:0.0:1788851357.146591:0:22800:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788851357.146689:0:22800:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892d89078800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788851357.146695:0:22800:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892d89078800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788851357.146697:0:22800:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892d89078800 4 00010000:00080000:0.0:1788851357.147911:0:22800:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892e983af800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1788851357.155665:0:22800:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788851357.157549:0:22800:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788851357.157599:0:22800:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788851357.157613:0:22800:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3e0030720b207384 00000100:00080000:0.0:1788851357.157625:0:22800:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788851357.157637:0:22800:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff892e983af800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851357.157672:0:22800:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892eb694f100 x1875746019841024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788851357.157731:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019841024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788851357.157914:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788851357.161694:0:22800:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788851357.162493:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019841024 00000100:00100000:2.0:1788851357.162506:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019841024 00000100:00100000:2.0:1788851357.162547:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788851357.162555:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019841024:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788851357.162647:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019841024:12345-0@lo:38:llog_process_th.0 Request processed in 91us (4733us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788851357.162654:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851357.167561:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788851357.167575:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e983af800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788851357.167584:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788851357.167589:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019841024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788851357.167988:0:22800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22800:1875746019841152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851357.168077:0:22800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851357.168113:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019841152 00000100:00100000:0.0:1788851357.168121:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019841152 00000100:00100000:0.0:1788851357.168169:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788851357.168177:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e89048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22800:x1875746019841152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851357.168292:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e89048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22800:x1875746019841152:12345-0@lo:502:llog_process_th.0 Request processed in 114us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851357.168301:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788851357.170968:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89afb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788851357.171006:0:22800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22800:1875746019841152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851357.171108:0:22800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22800:1875746019841280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851357.171173:0:22800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851357.171201:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e89afb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788851357.172450:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019841280 00000100:00100000:1.0:1788851357.172460:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019841280 00000100:00100000:1.0:1788851357.172516:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788851357.172527:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e89049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22800:x1875746019841280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851357.172687:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e89049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22800:x1875746019841280:12345-0@lo:502:llog_process_th.0 Request processed in 160us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851357.172695:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788851357.173486:0:22800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22800:1875746019841280:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788851357.175905:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788851357.177332:0:22748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788851357.177374:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788851357.177398:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdaba00/0x3e0030720b20736f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207376 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.177425:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebbdaba00/0x3e0030720b20736f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207376 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788851357.177484:0:22748:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788851357.177486:0:22748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788851357.177488:0:22748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851357.177490:0:22748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851357.177491:0:22748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851357.177493:0:22748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851357.177494:0:22748:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788851357.177496:0:22748:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788851357.177498:0:22748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851357.177500:0:22748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788851357.177504:0:22748:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788851357.177507:0:22748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788851357.177509:0:22748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788851357.177510:0:22748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851357.177511:0:22748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851357.177513:0:22748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851357.177514:0:22748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851357.177515:0:22748:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788851357.177516:0:22748:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788851357.177517:0:22748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851357.177518:0:22748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788851357.177549:0:22748:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788851357.177571:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019841408:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788851357.177648:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851357.177691:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81e13840 going to sleep for 11 seconds 00000100:00100000:1.0:1788851357.177961:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019841408 00000100:00100000:1.0:1788851357.177970:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019841408 00000100:00100000:1.0:1788851357.178057:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788851357.178068:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8904ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22748:x1875746019841408:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788851357.178102:0:22761:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788851357.178117:0:22761:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788851357.180291:0:22761:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788851357.180313:0:22761:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788851357.180613:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8904ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22748:x1875746019841408:12345-0@lo:253:mount.lustre.0 Request processed in 2544us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851357.180625:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:3.0:1788851357.180703:0:22785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788851357.180708:0:22785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788851357.180737:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.180755:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebbdab800/0x3e0030720b20735a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207353 expref: 11 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.180771:0:22785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.180913:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebbdab800/0x3e0030720b20735a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b207353 expref: 11 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.180927:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ebbdab800/0x3e0030720b20735a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b207353 expref: 11 pid: 22763 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851357.180939:0:22785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019841536:0@lo:104: 00000100:00100000:3.0:1788851357.180971:0:22785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851357.181009:0:22785:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81e13540 going to sleep for 11 seconds 00000100:00100000:0.0:1788851357.181097:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019841536 00000100:00100000:0.0:1788851357.181106:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019841536 00000100:00100000:0.0:1788851357.181135:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851357.181142:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+3:22785:x1875746019841536:12345-0@lo:104: 00010000:00010000:0.0:1788851357.181155:0:22752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20735a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.181202:0:22752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788851357.181208:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+3:22785:x1875746019841536:12345-0@lo:104: Request processed in 67us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851357.181220:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788851357.181305:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22748:1875746019841408:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788851357.181327:0:22748:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788851357.181330:0:22748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788851357.181332:0:22748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788851357.181334:0:22748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851357.181335:0:22748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851357.181337:0:22748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851357.181338:0:22748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851357.181339:0:22748:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788851357.181341:0:22748:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788851357.181342:0:22748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851357.181344:0:22748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788851357.181358:0:22748:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788851357.182428:0:22785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019841536:0@lo:104: 00010000:00010000:3.0:1788851357.182449:0:22785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.191367:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851357.191379:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20735a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.191391:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c200 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851357.191395:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20735a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.191407:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20735a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851357.191414:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20735a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851357.191420:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788851357.191466:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20735a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.191473:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851357.191507:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20735a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.191513:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b207353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20735a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.191528:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851357.191530:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851357.191532:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851357.191569:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788851357.191602:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019841664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851357.191680:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851357.192006:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019841664 00000100:00100000:0.0:1788851357.192038:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019841664 00010000:00010000:0.0:1788851357.192069:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebbdab800/0x3e0030720b20735a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207353 expref: 12 pid: 22763 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851357.192104:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851357.192112:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:3649:x1875746019841664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851357.192125:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851357.192130:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebbdab800/0x3e0030720b20735a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207353 expref: 12 pid: 22763 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.192142:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebbdab800/0x3e0030720b20735a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b207353 expref: 12 pid: 22763 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.192155:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebbdab800/0x3e0030720b20735a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b207353 expref: 12 pid: 22763 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.192169:0:22754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.192178:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788851357.192193:0:22754:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011485417s 00010000:00010000:0.0:1788851357.192198:0:22754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.192205:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.192222:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.192229:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.192235:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851357.192239:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.192248:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.192262:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851357.192271:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851357.192395:0:22785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.192404:0:22785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851357.192411:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433c000/0x3e0030720b20738b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851357.192500:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+11:3649:x1875746019841664:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851357.192508:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851357.192545:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019841664:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788851357.212173:0:22748:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:1.0:1788851357.212958:0:22748:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788851357.214826:0:22810:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:3.0:1788851357.214836:0:22810:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:0.0:1788851357.222949:0:22811:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788851357.223005:0:22748:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788851357.229064:0:22811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788851357.232534:0:22748:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788851357.232580:0:22748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788851357.234108:0:22811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788851357.234206:0:22811:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:0.0:1788851357.235192:0:22748:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788851357.235209:0:22748:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788851357.235299:0:22748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851357.237318:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00080000:1.0:1788851357.238269:0:22812:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff892e87078a80 x1875746019841792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851357.238284:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00000040:00080000:0.0:1788851357.239416:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788851357.239477:0:22748:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788851357.241498:0:22748:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788851357.244907:0:22748:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1788851357.248295:0:22748:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788851357.250593:0:22748:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788851357.250630:0:22748:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa990418ef988 00100000:10000000:0.0:1788851357.250637:0:22748:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788851357.251359:0:22748:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788851357.251379:0:22748:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788851357.251403:0:22748:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788851357.251421:0:22748:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788851357.260131:0:22748:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788851357.260434:0:22748:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788851357.749133:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851358.260638:0:22807:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788851358.260647:0:22807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788851358.263397:0:22807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788851358.263411:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788851358.263534:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 10000000:01000000:0.0:1788851358.709583:0:22766:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788851358.709591:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892d89078800 from 11 10000000:01000000:0.0:1788851358.709597:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788851358.709661:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851358.709680:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851358.709695:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851358.709721:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019841920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851358.709803:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851358.709865:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea7e71540 going to sleep for 11 seconds 00000100:00100000:1.0:1788851358.709975:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019841920 00000100:00100000:1.0:1788851358.709991:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019841920 00000100:00100000:1.0:1788851358.710066:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788851358.710075:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+11:22766:x1875746019841920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851358.710092:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851358.710107:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e827ea600/0x3e0030720b207399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207392 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851358.710137:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e827ea600/0x3e0030720b207399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207392 expref: 12 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851358.710148:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e827ea600/0x3e0030720b207399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207392 expref: 12 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851358.710157:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e827ea600, rc 0) 00000100:00100000:1.0:1788851358.710209:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22766:x1875746019841920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851358.710220:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788851358.710285:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019841920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851358.710300:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207399 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851358.710309:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b207399 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851358.710364:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019842048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788851358.710419:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851358.710435:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ebffad9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851358.710452:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019842048 00000100:00100000:1.0:1788851358.710462:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019842048 00000100:00100000:1.0:1788851358.710786:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788851358.710793:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22766:x1875746019842048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788851358.710813:0:22761:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788851358.710837:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788851358.710843:0:22761:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788851358.710935:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:22766:x1875746019842048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851358.710942:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788851358.710972:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019842048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788851358.711009:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788851358.711029:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207399 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851358.711037:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207399 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851358.773141:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851359.284198:0:22807:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788851359.284208:0:22807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788851359.284333:0:22807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788851359.284384:0:22807:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788851359.284550:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1788851359.289007:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00010000:00010000:0.0:1788851359.800117:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851360.309160:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00010000:00010000:0.0:1788851360.820242:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851361.332456:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00000001:02000400:3.0:1788851361.760338:0:23054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788851361.847308:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788851362.228463:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788851362.228471:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788851362.228475:0:36:0:(import.c:65:import_set_state_nolock()) ffff892e91592800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851362.228483:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 691 00000100:00080000:2.0:1788851362.228490:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788851362.228502:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff892e91592800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851362.228527:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea590dc00 x1875746019842304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788851362.228548:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851362.228552:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851362.228555:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851362.228558:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851362.228561:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788851362.228564:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788851362.228566:0:36:0:(import.c:65:import_set_state_nolock()) ffff892e983af800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851362.228572:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff892e983af800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851362.228584:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea590ca80 x1875746019842432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851362.228727:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3647:1875746019842176:0@lo:400:kworker.0 00000100:00100000:1.0:1788851362.228837:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851362.229315:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019842304:0@lo:38:kworker.0 00000100:00100000:0.0:1788851362.229381:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851362.229425:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019842432:0@lo:38:kworker.0 00000100:00100000:0.0:1788851362.229463:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851362.229637:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019842304 00000100:00100000:3.0:1788851362.229646:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019842304 00000100:00100000:3.0:1788851362.229698:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851362.229705:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875746019842304:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788851362.229726:0:22775:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788851362.230244:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875746019842304:12345-0@lo:38:kworker.0 Request processed in 535us (859us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788851362.230253:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851362.230296:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019842432 00000100:00100000:3.0:1788851362.230301:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019842432 00000100:00100000:3.0:1788851362.230320:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851362.230325:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019842432:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788851362.230344:0:22771:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:3.0:1788851362.230382:0:22771:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3e0030720b2073a0 00000004:00100000:3.0:1788851362.230416:0:22771:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788851362.230548:0:22771:0:(import.c:65:import_set_state_nolock()) ffff892ea5933000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851362.230594:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875746019842432:12345-0@lo:38:kworker.0 Request processed in 268us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851362.230602:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851362.231065:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019842176 00000100:00100000:2.0:1788851362.231072:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019842176 00000100:00100000:2.0:1788851362.231118:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788851362.231127:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:3647:x1875746019842176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851362.231185:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:3647:x1875746019842176:12345-0@lo:400:kworker.0 Request processed in 60us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851362.231211:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788851362.231335:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e91592800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788851362.231341:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788851362.231345:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019842304:0@lo:38:kworker.0 00010000:00080000:0.0:1788851362.231360:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff892ea590ca80 x1875746019842432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788851362.231374:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788851362.231382:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788851362.231387:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788851362.231390:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e983af800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788851362.231395:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875746019842432:0@lo:38:kworker.0 00000100:00100000:3.0:1788851362.232114:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3647:1875746019842176:0@lo:400:kworker.0 00000100:00100000:2.0:1788851362.356124:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00000020:00000004:3.0:1788851362.799894:0:23106:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788851362.801840:0:23106:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788851362.871121:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851363.381154:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00000020:00000004:2.0:1788851363.877811:0:23156:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788851363.880311:0:23156:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788851363.892276:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851364.404108:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00010000:00010000:1.0:1788851364.930670:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851365.428189:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00010000:00010000:2.0:1788851365.953867:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851366.454635:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00010000:00010000:2.0:1788851366.965312:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851367.350233:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851357/real 1788851357] req@ffff892eb694f480 x1875746019839360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851367 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851367.350272:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892eb694f480 x1875746019839360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851367 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851367.350294:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851357/real 1788851357] req@ffff892eb694d880 x1875746019839232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851367 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851367.350305:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892eb694d880 x1875746019839232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851367 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788851367.350328:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eb6998800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851367.350339:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788851367.350343:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019839360:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788851367.350348:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c57800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851367.350352:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788851367.350355:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019839232:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788851367.350733:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788851367.350738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788851367.350741:0:37:0:(import.c:65:import_set_state_nolock()) ffff892e91592800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851367.350746:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 696 00000100:00080000:1.0:1788851367.350753:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788851367.350764:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff892e91592800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851367.350785:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87079500 x1875746019842688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851367.350805:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851367.350807:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788851367.350809:0:37:0:(import.c:65:import_set_state_nolock()) ffff892d85c57800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851367.350812:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 691 00000100:00080000:1.0:1788851367.350814:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788851367.350820:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff892d85c57800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851367.350832:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e8707a680 x1875746019842816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851367.350840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851367.350843:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788851367.350844:0:37:0:(import.c:65:import_set_state_nolock()) ffff892eb6998800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851367.350848:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 691 00000100:00080000:1.0:1788851367.350850:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788851367.350854:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff892eb6998800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851367.350864:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e8707b100 x1875746019842944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851367.353248:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3648:1875746019842560:0@lo:400:kworker.0 00000100:00100000:3.0:1788851367.353337:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851367.353420:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788851367.353430:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019843072:0@lo:400:kworker.0 00000100:00100000:3.0:1788851367.353519:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851367.356314:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019842560 00000100:00100000:0.0:1788851367.356332:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019842560 00000100:00100000:0.0:1788851367.356412:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788851367.356425:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:3648:x1875746019842560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851367.356537:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:3648:x1875746019842560:12345-0@lo:400:kworker.0 Request processed in 115us (3200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851367.356545:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788851367.357549:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019843072 00000100:00100000:3.0:1788851367.357562:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019843072 00000100:00100000:3.0:1788851367.357616:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788851367.357625:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019843072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851367.357713:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019843072:12345-0@lo:400:kworker.0 Request processed in 88us (4192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851367.357720:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788851367.357784:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff892e87079180 x1875746019843072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851367.357810:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019843072:0@lo:400:kworker.0 00000100:00100000:0.0:1788851367.361867:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019842688:0@lo:38:kworker.0 00000100:00100000:0.0:1788851367.361946:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851367.361984:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019842816:0@lo:8:kworker.0 00000400:00000100:0.0:1788851367.362008:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019842816 offset 0 length 520: 4 00000100:00100000:0.0:1788851367.363360:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019842944:0@lo:8:kworker.0 00000400:00000100:0.0:1788851367.363414:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019842944 offset 0 length 520: 4 00000100:00100000:0.0:1788851367.363468:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019842688 00000100:00100000:0.0:1788851367.363479:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019842688 00000100:00100000:0.0:1788851367.363516:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851367.363523:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875746019842688:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788851367.363543:0:22775:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788851367.363591:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875746019842688:12345-0@lo:38:kworker.0 Request processed in 67us (1645us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788851367.363598:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851367.363644:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3648:1875746019842560:0@lo:400:kworker.0 00000100:00080000:0.0:1788851367.363694:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e91592800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788851367.363701:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788851367.363704:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019842688:0@lo:38:kworker.0 00000100:00100000:0.0:1788851367.476230:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00010000:00010000:3.0:1788851367.993978:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851368.501894:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00010000:00010000:1.0:1788851369.019659:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851369.525676:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788851369.525918:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00010000:00010000:3.0:1788851370.040742:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851370.548166:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00010000:00010000:2.0:1788851371.060267:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788851371.240423:0:23502:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788851371.240432:0:23502:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788851371.240433:0:23502:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788851371.240559:0:23502:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff892eb6cf0800 00000020:01000004:0.0:1788851371.240577:0:23502:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788851371.240599:0:23502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788851371.240614:0:23502:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff892d874a19c0) 00000020:00000080:0.0:1788851371.240631:0:23502:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788851371.365546:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788851371.366534:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.368358:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788851371.370946:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788851371.371764:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788851371.371976:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788851371.372204:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788851371.372703:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788851371.372901:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788851371.373332:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788851371.373558:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788851371.373759:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788851371.374077:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788851371.374568:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788851371.377906:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.378829:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.379008:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.379405:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.380744:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.380993:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.381379:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.381685:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.381858:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.382159:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.382419:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.382616:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.382904:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.383495:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.383859:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.384231:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.384475:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.384730:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.387113:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.387685:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.387948:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.388309:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.388595:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.388782:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.388961:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.389237:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.389424:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.389933:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788851371.390592:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.390883:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.391214:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788851371.391457:0:23502:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00080000:01000000:3.0:1788851371.392413:0:23502:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788851371.392650:0:23502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788851371.392677:0:23502:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788851371.392690:0:23502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b2073ae 00000020:01000004:3.0:1788851371.392699:0:23502:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788851371.392721:0:23502:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788851371.392725:0:23502:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788851371.392731:0:23502:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788851371.392760:0:23502:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788851371.392766:0:23502:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788851371.401977:0:23502:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788851371.402318:0:23502:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788851371.402324:0:23502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788851371.402326:0:23502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788851371.402328:0:23502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788851371.402329:0:23502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788851371.402331:0:23502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788851371.402333:0:23502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788851371.402335:0:23502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788851371.402337:0:23502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788851371.402339:0:23502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788851371.402343:0:23502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788851371.402346:0:23502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788851371.402347:0:23502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788851371.402349:0:23502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788851371.402350:0:23502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788851371.402351:0:23502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788851371.402352:0:23502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788851371.402353:0:23502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788851371.402354:0:23502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788851371.402355:0:23502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788851371.402398:0:23502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788851371.402424:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843200:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788851371.402601:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.402726:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90913e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851371.402964:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019843200 00000100:00100000:1.0:1788851371.402975:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019843200 00000100:00100000:1.0:1788851371.409597:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788851371.409624:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:23502:x1875746019843200:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788851371.409676:0:22761:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788851371.409693:0:22761:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788851371.409701:0:22761:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788851371.410324:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:23502:x1875746019843200:12345-0@lo:253:mount.lustre.0 Request processed in 712us (7720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851371.410334:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788851371.416672:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843200:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788851371.416693:0:23502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788851371.416696:0:23502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788851371.416714:0:23502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788851371.416716:0:23502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788851371.416717:0:23502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788851371.416719:0:23502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788851371.416720:0:23502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788851371.416721:0:23502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788851371.416723:0:23502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788851371.416725:0:23502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788851371.416768:0:23502:0:(tgt_mount.c:101:server_register_mount()) register mount ffff892eb6cf0800 from lustre-MDT0001 10000000:01000000:0.0:1788851371.416800:0:23502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788851371.416803:0:23502:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788851371.416809:0:23502:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff892ead6d8000 local copy 00010000:00010000:0.0:1788851371.416820:0:23502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851371.416919:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851371.416980:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.419865:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90913540 going to sleep for 11 seconds 00000100:00100000:3.0:1788851371.421262:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019843328 00000100:00100000:3.0:1788851371.421276:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019843328 00000100:00100000:2.0:1788851371.421464:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788851371.421474:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:23502:x1875746019843328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851371.421760:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:23502:x1875746019843328:12345-0@lo:501:mount.lustre.0 Request processed in 287us (4779us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788851371.421768:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788851371.421877:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843328:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788851371.421909:0:23502:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788851371.421937:0:23502:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788851371.421947:0:23502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.421957:0:23502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851371.421991:0:23502:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff892eb6cf0800 10000000:01000000:0.0:1788851371.421996:0:23502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788851371.422002:0:23502:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff892ead6d8000 10000000:01000000:0.0:1788851371.422004:0:23502:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788851371.422061:0:23502:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff892ead6d8000 from 1 10000000:01000000:0.0:1788851371.422065:0:23502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788851371.422098:0:23502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdab800/0x3e0030720b2073b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.422107:0:23502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebbdab800/0x3e0030720b2073b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.422118:0:23502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebbdab800/0x3e0030720b2073b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851371.422138:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788851371.422176:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.422264:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90913540 going to sleep for 11 seconds 00000100:00100000:1.0:1788851371.423222:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019843456 00000100:00100000:1.0:1788851371.423231:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019843456 00000100:00100000:2.0:1788851371.424962:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788851371.424973:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+12:23502:x1875746019843456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851371.424991:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851371.425027:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff95600/0x3e0030720b2073bc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2073b5 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851371.425144:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff95600/0x3e0030720b2073bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2073b5 expref: 13 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851371.425155:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff95600/0x3e0030720b2073bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2073b5 expref: 13 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851371.425164:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95600, rc 0) 00000100:00100000:2.0:1788851371.425271:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+13:23502:x1875746019843456:12345-0@lo:101:mount.lustre.0 Request processed in 300us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851371.425279:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788851371.425382:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851371.425400:0:23502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebbdab800/0x3e0030720b2073b5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2073bc expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.425409:0:23502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebbdab800/0x3e0030720b2073b5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2073bc expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851371.425432:0:23502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788851371.425453:0:23502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdab800/0x3e0030720b2073b5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2073bc expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.425461:0:23502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebbdab800/0x3e0030720b2073b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2073bc expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851371.425473:0:23502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff892eb6cf0800 10000000:01000000:3.0:1788851371.425479:0:23502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788851371.425484:0:23502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff892eb6cf0800 from 1 10000000:01000000:3.0:1788851371.425486:0:23502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788851371.425526:0:23502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b2073c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.425544:0:23502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b2073c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.425555:0:23502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b2073c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851371.425576:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788851371.425628:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851371.425946:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81e13cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851371.426026:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019843584 00000100:00100000:0.0:1788851371.426033:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019843584 00000100:00100000:1.0:1788851371.427695:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788851371.427707:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+13:23502:x1875746019843584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851371.427723:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851371.427740:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e827eb400/0x3e0030720b2073ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2073c3 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851371.427766:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e827eb400/0x3e0030720b2073ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2073c3 expref: 14 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851371.427777:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e827eb400/0x3e0030720b2073ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2073c3 expref: 14 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851371.427785:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e827eb400, rc 0) 00000100:00100000:1.0:1788851371.427906:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+14:23502:x1875746019843584:12345-0@lo:101:mount.lustre.0 Request processed in 200us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851371.427914:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788851371.429751:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851371.429776:0:23502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b2073c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2073ca expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.429788:0:23502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b2073c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2073ca expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851371.429806:0:23502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788851371.429856:0:23502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b2073c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2073ca expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.429865:0:23502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433c000/0x3e0030720b2073c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2073ca expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851371.429872:0:23502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788851371.429992:0:23502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788851371.430001:0:23502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff892eb6cf0800 10000000:01000000:2.0:1788851371.430004:0:23502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788851371.430009:0:23502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788851371.430036:0:23502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788851371.430083:0:23502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94000/0x3e0030720b2073d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851371.430091:0:23502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebff94000/0x3e0030720b2073d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851371.430099:0:23502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebff94000/0x3e0030720b2073d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851371.430119:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788851371.430179:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851371.430225:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851371.430402:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019843712 00000100:00100000:3.0:1788851371.430411:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019843712 00000100:00100000:3.0:1788851371.430461:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788851371.430469:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+14:23502:x1875746019843712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851371.430501:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851371.430526:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433ce00/0x3e0030720b2073d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2073d1 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.430550:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433ce00/0x3e0030720b2073d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2073d1 expref: 15 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.430559:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433ce00/0x3e0030720b2073d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2073d1 expref: 15 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.430567:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433ce00, rc 0) 00000100:00100000:3.0:1788851371.430622:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+15:23502:x1875746019843712:12345-0@lo:101:mount.lustre.0 Request processed in 153us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851371.430629:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788851371.430827:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851371.430841:0:23502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebff94000/0x3e0030720b2073d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2073d8 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851371.430850:0:23502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebff94000/0x3e0030720b2073d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2073d8 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788851371.433769:0:23502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1788851371.434504:0:23502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788851371.441601:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788851371.441691:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1788851371.441707:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1788851371.441723:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1788851371.441742:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1788851371.441757:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1788851371.441772:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1788851371.441787:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1788851371.441801:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1788851371.441816:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1788851371.441830:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1788851371.441845:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1788851371.441860:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1788851371.441875:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1788851371.441890:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1788851371.441904:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1788851371.441919:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1788851371.441933:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1788851371.441947:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1788851371.441962:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1788851371.441975:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1788851371.441988:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1788851371.442002:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1788851371.442148:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1788851371.442169:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1788851371.442182:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1788851371.442195:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1788851371.442207:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1788851371.442219:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1788851371.442231:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1788851371.442243:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1788851371.442254:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1788851371.442267:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1788851371.442299:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1788851371.442313:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1788851371.442326:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1788851371.442340:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1788851371.442352:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1788851371.442366:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1788851371.442379:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1788851371.442391:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1788851371.442404:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1788851371.442416:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1788851371.442429:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1788851371.442461:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1788851371.442468:0:23502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1788851371.442661:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851371.442728:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851371.442933:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788851371.442986:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019843840 00000100:00100000:0.0:1788851371.442996:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019843840 00000100:00100000:0.0:1788851371.443329:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788851371.443339:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+15:23502:x1875746019843840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851371.443520:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+15:23502:x1875746019843840:12345-0@lo:501:mount.lustre.0 Request processed in 173us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851371.443529:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788851371.443614:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851371.443651:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851371.443696:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851371.443855:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788851371.443944:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019843968 00000100:00100000:3.0:1788851371.443950:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019843968 00000100:00100000:3.0:1788851371.443977:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788851371.443984:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+15:23502:x1875746019843968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851371.444875:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+15:23502:x1875746019843968:12345-0@lo:503:mount.lustre.0 Request processed in 885us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851371.444886:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788851371.445131:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019843968:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788851371.445761:0:23502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788851371.445851:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019844096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851371.445916:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851371.445958:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851371.446534:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019844096 00000100:00100000:3.0:1788851371.446543:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019844096 00000100:00100000:3.0:1788851371.446600:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788851371.446609:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+15:23502:x1875746019844096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851371.448061:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+15:23502:x1875746019844096:12345-0@lo:502:mount.lustre.0 Request processed in 1444us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851371.448090:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788851371.448258:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019844096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851371.448551:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788851371.448608:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788851371.448625:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788851371.448640:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1788851371.448654:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1788851371.448667:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1788851371.448680:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1788851371.448692:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1788851371.448705:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1788851371.448717:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1788851371.448730:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1788851371.448742:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1788851371.448759:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1788851371.448770:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1788851371.448780:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1788851371.448791:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1788851371.448803:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1788851371.448814:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1788851371.448826:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1788851371.448838:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1788851371.448850:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1788851371.448863:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1788851371.448875:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1788851371.448886:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1788851371.448896:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1788851371.448906:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1788851371.448917:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1788851371.448927:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1788851371.448939:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1788851371.448950:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1788851371.448962:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1788851371.448974:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1788851371.448986:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1788851371.448999:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1788851371.449234:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1788851371.449248:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1788851371.449259:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1788851371.449269:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1788851371.449279:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1788851371.449290:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1788851371.449302:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1788851371.449315:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1788851371.449330:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1788851371.449342:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1788851371.449386:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019844224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851371.449450:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851371.449495:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851371.449733:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019844224 00000100:00100000:3.0:1788851371.449741:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019844224 00000100:00100000:3.0:1788851371.449780:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788851371.449789:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+15:23502:x1875746019844224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851371.449923:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+15:23502:x1875746019844224:12345-0@lo:502:mount.lustre.0 Request processed in 134us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851371.449931:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788851371.450340:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019844224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851371.450403:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788851371.450413:0:23502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788851371.455944:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851371.455966:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851371.455970:0:23507:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788851371.455976:0:23507:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788851371.455979:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788851371.455998:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff892d874a0000) 00000020:00000080:0.0:1788851371.456060:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788851371.456083:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788851371.456183:0:23507:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788851371.456191:0:23507:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b2073e6 00000020:00000080:0.0:1788851371.456409:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788851371.456415:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851371.456418:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851371.456419:0:23507:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788851371.456422:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851371.456426:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851371.456427:0:23507:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788851371.456430:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788851371.456445:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff892eaca0b380) 00000020:00000080:0.0:1788851371.456456:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788851371.456461:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788851371.456464:0:23507:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788851371.456466:0:23507:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788851371.456472:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788851371.456680:0:23507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892eb6cf0800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788851371.456693:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff892eaca0cd40) 00000020:00000080:0.0:1788851371.456702:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788851371.456768:0:23507:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788851371.456773:0:23507:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b2073fb 00000020:00000080:0.0:1788851371.456859:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788851371.456866:0:23507:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788851371.456870:0:23507:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x3e0030720b207402 00080000:01000000:0.0:1788851371.456876:0:23507:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788851371.456879:0:23507:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b207409 00010000:00010000:3.0:1788851371.556966:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788851371.557753:0:23507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1788851371.558307:0:23507:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788851371.559468:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788851371.559481:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851371.559487:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851371.559489:0:23507:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788851371.559493:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851371.559499:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851371.559500:0:23507:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788851371.559503:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788851371.559516:0:23507:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:3.0:1788851371.559544:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788851371.559558:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff892ead6db380) 00000020:00000080:3.0:1788851371.559588:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788851371.559595:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788851371.559668:0:23507:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788851371.559675:0:23507:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788851371.559683:0:23507:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b207417 00010000:00080000:3.0:1788851371.559719:0:23507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d88063000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1788851371.566151:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788851371.572704:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788851371.572723:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788851371.572768:0:23507:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788851371.572793:0:23507:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b20741e 00000100:00080000:2.0:1788851371.572806:0:23507:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788851371.572818:0:23507:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff892d88063000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851371.572860:0:23507:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea590ed80 x1875746019844352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788851371.574564:0:23507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788851371.574675:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851371.574680:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851371.574682:0:23507:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788851371.574685:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788851371.574700:0:23507:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788851371.574701:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788851371.574703:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788851371.574705:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788851371.574708:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851371.574709:0:23507:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788851371.574712:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851371.574716:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851371.574718:0:23507:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788851371.574722:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788851371.574771:0:23507:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788851371.574782:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851371.574785:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851371.574786:0:23507:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788851371.574789:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788851371.574790:0:23507:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788851371.574791:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788851371.574793:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788851371.574794:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788851371.574796:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851371.574797:0:23507:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788851371.574800:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788851371.574803:0:23507:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788851371.574806:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851371.574807:0:23507:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788851371.574810:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788851371.574814:0:23507:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:2.0:1788851371.574840:0:23507:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788851371.574843:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788851371.574858:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff892d85c63380) 00000020:00000080:2.0:1788851371.574875:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788851371.574880:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788851371.574945:0:23507:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788851371.574952:0:23507:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788851371.574962:0:23507:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b20742c 00000100:00080000:3.0:1788851371.575219:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788851371.575224:0:23321:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788851371.575228:0:23321:0:(import.c:65:import_set_state_nolock()) ffff892e91592800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851371.575233:0:23321:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 701 00000100:00080000:3.0:1788851371.575239:0:23321:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788851371.575248:0:23321:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff892e91592800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851371.575292:0:23321:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d8839b480 x1875746019844480/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851371.575307:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851371.575310:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788851371.575313:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851371.575316:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788851371.575362:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019844608:0@lo:400:kworker.0 00000100:00100000:3.0:1788851371.575424:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851371.575475:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019844608 00000100:00100000:3.0:1788851371.575482:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019844608 00000100:00100000:3.0:1788851371.575533:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851371.575542:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019844608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851371.575602:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019844608:12345-0@lo:400:kworker.0 Request processed in 61us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851371.575609:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788851371.575647:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff892d88398000 x1875746019844608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851371.575661:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019844608:0@lo:400:kworker.0 00000100:00100000:0.0:1788851371.575943:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019844352:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788851371.575981:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788851371.576638:0:23507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892e87c1f800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1788851371.576875:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788851371.577163:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019844480:0@lo:38:kworker.0 00000100:00100000:0.0:1788851371.577206:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.577258:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019844352 00000100:00100000:0.0:1788851371.577272:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019844352 00000100:00100000:0.0:1788851371.577295:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019844480 00000100:00100000:0.0:1788851371.577297:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019844480 00000100:00100000:0.0:1788851371.577308:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851371.577313:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019844352:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788851371.577337:0:22774:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:0.0:1788851371.577369:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b207433 00000004:00100000:0.0:1788851371.577382:0:22774:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788851371.577389:0:22774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788851371.580078:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00000040:01000000:2.0:1788851371.582847:0:23507:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788851371.583840:0:23507:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788851371.588689:0:23507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851371.589196:0:23507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788851371.589337:0:23507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:2.0:1788851371.590101:0:22774:0:(import.c:65:import_set_state_nolock()) ffff892e87c1b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851371.590209:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875746019844352:12345-0@lo:38:llog_process_th.0 Request processed in 12892us (14224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851371.590220:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788851371.590252:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788851371.590258:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019844480:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788851371.590298:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019844480:12345-0@lo:38:kworker.0 Request processed in 40us (13092us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788851371.590303:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851371.590384:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788851371.590394:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788851371.590404:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788851371.590410:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788851371.590412:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d88063000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788851371.590429:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019844352:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788851371.590442:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788851371.590446:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e91592800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788851371.590449:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788851371.590452:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019844480:0@lo:38:kworker.0 00000100:00100000:0.0:1788851371.590613:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851371.590627:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019844736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851371.590666:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851371.590758:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019844736 00000100:00100000:1.0:1788851371.590764:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019844736 00000100:00100000:1.0:1788851371.590807:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788851371.590823:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875746019844736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851371.590848:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788851371.590892:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875746019844736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851371.590910:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851371.590989:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019844736:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788851371.591491:0:23512:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788851371.591496:0:23512:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788851371.592200:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788851371.592212:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788851371.592252:0:23507:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788851371.592277:0:23507:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b20743a 00000100:00080000:3.0:1788851371.592286:0:23507:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788851371.592297:0:23507:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff892e87c1f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851371.592329:0:23507:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d88398000 x1875746019844864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851371.592351:0:23507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788851371.592405:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851371.592409:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851371.592411:0:23507:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788851371.592414:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788851371.592417:0:23507:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788851371.592419:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788851371.592420:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788851371.592422:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788851371.592424:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851371.592425:0:23507:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788851371.592428:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788851371.592432:0:23507:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788851371.592435:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851371.592437:0:23507:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788851371.592440:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788851371.592443:0:23507:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:3.0:1788851371.592464:0:23507:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788851371.592467:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788851371.592487:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff892d87ac3380) 00000020:00000080:3.0:1788851371.592505:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000100:00100000:0.0:1788851371.592624:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019844864:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788851371.592682:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019844864 offset 0 length 520: 4 00000100:00080000:1.0:1788851371.592789:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851371.592794:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851371.592797:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851371.592799:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1788851371.592957:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788851371.593249:0:23507:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788851371.593256:0:23507:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788851371.593268:0:23507:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x3e0030720b207448 00010000:00080000:3.0:1788851371.593299:0:23507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892e90e54000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1788851371.594713:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788851371.594788:0:23507:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788851371.594806:0:23507:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788851371.598729:0:23507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851371.599285:0:23507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788851371.599436:0:23507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1788851371.601702:0:23514:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788851371.601711:0:23514:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788851371.602692:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788851371.602705:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788851371.602745:0:23507:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788851371.602767:0:23507:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b20744f 00000100:00080000:0.0:1788851371.602777:0:23507:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788851371.602788:0:23507:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892e90e54000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1788851371.602828:0:23507:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892eb694f800 x1875746019844992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851371.602899:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019844992:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788851371.602951:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019844992 offset 0 length 520: 4 00000100:00080000:0.0:1788851371.603052:0:23507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788851371.603114:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851371.603119:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851371.603121:0:23507:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788851371.603124:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851371.603128:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851371.603130:0:23507:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788851371.603133:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788851371.603135:0:23507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788851371.603137:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851371.603140:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851371.603141:0:23507:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788851371.603143:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851371.603145:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851371.603152:0:23507:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788851371.603157:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788851371.603193:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851371.603196:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851371.603197:0:23507:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788851371.603201:0:23507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:3.0:1788851371.603445:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851371.603451:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788851371.603454:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851371.603457:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788851371.604084:0:23502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788851371.604124:0:23502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788851371.604146:0:23502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94000/0x3e0030720b2073d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2073d8 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.604159:0:23502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff94000/0x3e0030720b2073d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2073d8 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851371.604168:0:23502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892eb6cf0800 from 1 10000000:01000000:3.0:1788851371.604170:0:23502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788851371.604203:0:23502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.604211:0:23502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.604239:0:23502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851371.604263:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788851371.604328:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851371.604363:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6c2e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788851371.604382:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019845120 00000100:00100000:3.0:1788851371.604389:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019845120 00000100:00100000:3.0:1788851371.604436:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788851371.604446:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+15:23502:x1875746019845120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851371.604460:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851371.604472:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433d800/0x3e0030720b20745d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207456 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.604496:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433d800/0x3e0030720b20745d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207456 expref: 16 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.604507:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433d800/0x3e0030720b20745d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207456 expref: 16 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.604515:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d800, rc 0) 00000100:00100000:3.0:1788851371.604545:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+16:23502:x1875746019845120:12345-0@lo:101:mount.lustre.0 Request processed in 100us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851371.604552:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788851371.604605:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851371.604617:0:23502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20745d expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851371.604631:0:23502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20745d expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851371.605131:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845248:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788851371.605173:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851371.605196:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6c2e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788851371.606116:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019845248 00000100:00100000:0.0:1788851371.606125:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019845248 00000100:00100000:0.0:1788851371.606186:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788851371.606194:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+16:23502:x1875746019845248:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788851371.606215:0:22761:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788851371.606241:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788851371.606244:0:22761:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788851371.606352:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+16:23502:x1875746019845248:12345-0@lo:256:mount.lustre.0 Request processed in 158us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851371.606361:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788851371.606426:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845248:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788851371.607517:0:23502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788851371.607536:0:23502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20745d expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.607549:0:23502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20745d expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851371.607558:0:23502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892eb6cf0800 from 1 10000000:01000000:0.0:1788851371.607561:0:23502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851371.607605:0:23502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.607612:0:23502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.607629:0:23502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851371.607652:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788851371.607696:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.607728:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8679ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851371.607749:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019845376 00000100:00100000:0.0:1788851371.607755:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019845376 00000100:00100000:0.0:1788851371.607800:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788851371.607807:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89069c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+16:23502:x1875746019845376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851371.607818:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851371.607829:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebbdaa400/0x3e0030720b20746b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207464 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.607852:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebbdaa400/0x3e0030720b20746b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207464 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.607863:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebbdaa400/0x3e0030720b20746b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207464 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.607871:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdaa400, rc 0) 00000100:00100000:0.0:1788851371.607901:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89069c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:23502:x1875746019845376:12345-0@lo:101:mount.lustre.0 Request processed in 95us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851371.607906:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788851371.607937:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845376:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851371.607950:0:23502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20746b expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.607963:0:23502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20746b expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851371.611214:0:23502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1788851371.611537:0:23502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851371.611746:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788851371.611772:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1788851371.611787:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1788851371.611801:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1788851371.611815:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1788851371.611827:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1788851371.611839:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1788851371.611851:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1788851371.611864:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788851371.611877:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1788851371.611899:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1788851371.611916:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1788851371.611921:0:23502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1788851371.612205:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851371.612306:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.612409:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e861a2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851371.614751:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019845504 00000100:00100000:3.0:1788851371.614767:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019845504 00000100:00100000:3.0:1788851371.614884:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788851371.614897:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89068c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:23502:x1875746019845504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851371.615123:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89068c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:23502:x1875746019845504:12345-0@lo:501:mount.lustre.0 Request processed in 229us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851371.615131:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788851371.615226:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851371.615280:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851371.615328:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851371.615812:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6eb0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788851371.615873:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019845632 00000100:00100000:2.0:1788851371.615880:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019845632 00000100:00100000:2.0:1788851371.615910:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788851371.615917:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:23502:x1875746019845632:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851371.616191:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:23502:x1875746019845632:12345-0@lo:503:mount.lustre.0 Request processed in 273us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851371.616197:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788851371.616284:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845632:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788851371.616866:0:23502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788851371.616958:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851371.617234:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851371.617270:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6eb0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788851371.617347:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019845760 00000100:00100000:2.0:1788851371.617353:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019845760 00000100:00100000:2.0:1788851371.617384:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788851371.617391:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:23502:x1875746019845760:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851371.617497:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:23502:x1875746019845760:12345-0@lo:502:mount.lustre.0 Request processed in 106us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851371.617601:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788851371.617865:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788851371.617894:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1788851371.617906:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1788851371.617918:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1788851371.617930:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1788851371.617944:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1788851371.617970:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000100:00100000:2.0:1788851371.620300:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:1.0:1788851371.620667:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1788851371.620732:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788851371.620747:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1788851371.620759:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1788851371.620823:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851371.620912:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851371.620956:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6eb0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788851371.621114:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019845888 00000100:00100000:2.0:1788851371.621124:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019845888 00000100:00100000:2.0:1788851371.621221:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788851371.621232:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:23502:x1875746019845888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851371.621370:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:23502:x1875746019845888:12345-0@lo:502:mount.lustre.0 Request processed in 139us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851371.621376:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788851371.621466:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019845888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788851371.621543:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1788851371.621553:0:23502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788851371.626745:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851371.626759:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851371.626761:0:23516:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788851371.626769:0:23516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892eb6cf0800 00000020:00000080:2.0:1788851371.626772:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851371.626780:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851371.626782:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851371.626783:0:23516:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788851371.626786:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851371.626788:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851371.626789:0:23516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788851371.626792:0:23516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892eb6cf0800 00000020:00000080:2.0:1788851371.626794:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851371.626924:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851371.626928:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851371.626930:0:23516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788851371.626932:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851371.626935:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851371.626936:0:23516:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788851371.626940:0:23516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892eb6cf0800 00000020:00000080:2.0:1788851371.626942:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851371.629774:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851371.633490:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851371.633499:0:23516:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788851371.633525:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851371.633533:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851371.633535:0:23516:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788851371.633542:0:23516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892eb6cf0800 00000020:00000080:0.0:1788851371.633544:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788851371.633640:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851371.633643:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851371.633651:0:23516:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788851371.633654:0:23516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1788851371.633877:0:23502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788851371.633912:0:23502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851371.633935:0:23502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20746b expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851371.633948:0:23502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20746b expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851371.634009:0:23502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788851371.634045:0:23502:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff892eb6cf0800 10000000:01000000:1.0:1788851371.634048:0:23502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff892eb6cf0800 10000000:01000000:1.0:1788851371.634054:0:23502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788851371.634061:0:23502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892eb6cf0800 from 1 10000000:01000000:1.0:1788851371.634065:0:23502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788851371.634111:0:23502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea800/0x3e0030720b207472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851371.634120:0:23502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827ea800/0x3e0030720b207472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851371.634146:0:23502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827ea800/0x3e0030720b207472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851371.634174:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851371.634257:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851371.634310:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6eb00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851371.636701:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019846016 00000100:00100000:0.0:1788851371.636720:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019846016 00000100:00100000:0.0:1788851371.636794:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788851371.636804:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:23502:x1875746019846016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851371.636821:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851371.636838:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebbdabe00/0x3e0030720b207479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207472 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.636866:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebbdabe00/0x3e0030720b207479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207472 expref: 18 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.636877:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebbdabe00/0x3e0030720b207479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207472 expref: 18 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.636886:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdabe00, rc 0) 00000100:00100000:0.0:1788851371.636958:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:23502:x1875746019846016:12345-0@lo:101:mount.lustre.0 Request processed in 156us (2703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851371.636965:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788851371.637034:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851371.637052:0:23502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827ea800/0x3e0030720b207472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207479 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.637062:0:23502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827ea800/0x3e0030720b207472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b207479 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851371.638762:0:23502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1788851371.643051:0:23502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851371.643742:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1788851371.643791:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1788851371.643807:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1788851371.643823:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1788851371.643840:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1788851371.643859:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1788851371.643879:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1788851371.643899:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1788851371.643919:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1788851371.643934:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1788851371.643947:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1788851371.643963:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1788851371.643976:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1788851371.643993:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1788851371.644010:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1788851371.644076:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1788851371.644094:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1788851371.644108:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1788851371.644125:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1788851371.644144:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1788851371.644174:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1788851371.644191:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1788851371.644208:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1788851371.644227:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1788851371.644242:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1788851371.644256:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1788851371.644270:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1788851371.644285:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1788851371.644300:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1788851371.644316:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1788851371.644335:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1788851371.644354:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1788851371.644375:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1788851371.644406:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1788851371.644422:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1788851371.644440:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1788851371.644460:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1788851371.644477:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1788851371.644496:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1788851371.644514:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1788851371.644533:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1788851371.644554:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1788851371.644570:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1788851371.644607:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1788851371.644627:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1788851371.644645:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1788851371.644666:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1788851371.644683:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1788851371.644862:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1788851371.644886:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1788851371.644909:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1788851371.644916:0:23502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1788851371.645068:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851371.645155:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.645219:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019846144 00000100:00100000:0.0:1788851371.645232:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019846144 00000100:00100000:0.0:1788851371.645292:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788851371.645304:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89069850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:23502:x1875746019846144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851371.646972:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89069850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:23502:x1875746019846144:12345-0@lo:501:mount.lustre.0 Request processed in 1658us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851371.646992:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788851371.647102:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788851371.647134:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851371.647727:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788851371.647795:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.647829:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851371.648268:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019846272 00000100:00100000:2.0:1788851371.648277:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019846272 00000100:00100000:2.0:1788851371.648337:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788851371.648348:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89068450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:23502:x1875746019846272:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851371.648487:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89068450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:23502:x1875746019846272:12345-0@lo:503:mount.lustre.0 Request processed in 141us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851371.648496:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788851371.648613:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846272:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788851371.649128:0:23502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788851371.649647:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851371.650270:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.650310:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788851371.650335:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019846400 00000100:00100000:0.0:1788851371.650342:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019846400 00000100:00100000:0.0:1788851371.650398:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788851371.650407:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89069450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:23502:x1875746019846400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851371.650596:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89069450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:23502:x1875746019846400:12345-0@lo:502:mount.lustre.0 Request processed in 189us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851371.650605:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788851371.650670:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788851371.651001:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788851371.651060:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1788851371.651075:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1788851371.651087:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1788851371.651100:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1788851371.651129:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1788851371.651213:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1788851371.651236:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1788851371.651250:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788851371.651265:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1788851371.651290:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1788851371.651306:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1788851371.651320:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1788851371.651333:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1788851371.651346:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1788851371.651363:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1788851371.651378:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1788851371.651394:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1788851371.651410:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1788851371.651867:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1788851371.651887:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1788851371.651921:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1788851371.651941:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1788851371.651961:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1788851371.651979:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1788851371.651991:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1788851371.652004:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1788851371.652048:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1788851371.652065:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1788851371.652078:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1788851371.652091:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1788851371.652104:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1788851371.652115:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1788851371.652128:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1788851371.652143:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1788851371.652234:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1788851371.652249:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1788851371.652276:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1788851371.652292:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1788851371.652305:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1788851371.652317:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1788851371.652328:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1788851371.652341:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1788851371.652365:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1788851371.652378:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1788851371.652391:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1788851371.652404:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1788851371.652418:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1788851371.652471:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846528:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851371.652618:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.652662:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851371.654480:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019846528 00000100:00100000:2.0:1788851371.654496:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019846528 00000100:00100000:2.0:1788851371.654587:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788851371.654742:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:23502:x1875746019846528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851371.655185:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:23502:x1875746019846528:12345-0@lo:502:mount.lustre.0 Request processed in 588us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851371.655194:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788851371.655768:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788851371.656183:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1788851371.656219:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1788851371.656274:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851371.656854:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.656930:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019846656 00000100:00100000:0.0:1788851371.656940:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019846656 00000100:00100000:0.0:1788851371.657005:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788851371.657163:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89068050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:23502:x1875746019846656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851371.657306:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89068050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:23502:x1875746019846656:12345-0@lo:502:mount.lustre.0 Request processed in 292us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851371.657314:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788851371.657377:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788851371.657401:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788851371.657481:0:23502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1788851371.657494:0:23502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788851371.661570:0:23521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788851371.661686:0:23521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff892d85c619c0) 00000020:00000080:2.0:1788851371.661712:0:23521:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788851371.661893:0:23521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892eb6cf0800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788851371.661898:0:23521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892eb6cf0800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788851371.661901:0:23521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892eb6cf0800 3 00010000:00080000:2.0:1788851371.661935:0:23521:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892e82cc3800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1788851371.664602:0:23521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788851371.664857:0:23521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788851371.664903:0:23521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788851371.664919:0:23521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x3e0030720b207487 00000100:00080000:2.0:1788851371.664931:0:23521:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788851371.664943:0:23521:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff892e82cc3800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851371.664984:0:23521:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea590e300 x1875746019846784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788851371.665034:0:23521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788851371.665060:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851371.665076:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851371.665079:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851371.665083:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788851371.665170:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019846784:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788851371.665253:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851371.665335:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019846784 00000100:00100000:1.0:1788851371.665345:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019846784 00000100:00100000:1.0:1788851371.665380:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788851371.665388:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019846784:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788851371.665416:0:22771:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:1.0:1788851371.665451:0:22771:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x3e0030720b20748e 00000004:00100000:1.0:1788851371.665467:0:22771:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788851371.665500:0:22771:0:(import.c:65:import_set_state_nolock()) ffff892ea568f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851371.666699:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875746019846784:12345-0@lo:38:llog_process_th.0 Request processed in 1305us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851371.666710:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788851371.666768:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff892ea590e300 x1875746019846784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851371.666780:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788851371.666788:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788851371.666795:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788851371.666800:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788851371.666808:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e82cc3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788851371.666815:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875746019846784:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788851371.672884:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1788851371.673009:0:23502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788851371.673952:0:23502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788851371.673985:0:23502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea800/0x3e0030720b207472 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207479 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.673998:0:23502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827ea800/0x3e0030720b207472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207479 expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788851371.674168:0:23502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788851371.674171:0:23502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788851371.674172:0:23502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788851371.674174:0:23502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788851371.674175:0:23502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788851371.674176:0:23502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788851371.674178:0:23502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788851371.674179:0:23502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788851371.674181:0:23502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788851371.674185:0:23502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788851371.674188:0:23502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788851371.674189:0:23502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788851371.674190:0:23502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788851371.674191:0:23502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788851371.674192:0:23502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788851371.674193:0:23502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788851371.674194:0:23502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788851371.674195:0:23502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788851371.674196:0:23502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788851371.674227:0:23502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788851371.674249:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788851371.674330:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.674372:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019846912 00000100:00100000:0.0:1788851371.674380:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019846912 00000100:00100000:0.0:1788851371.674424:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788851371.674432:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:23502:x1875746019846912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788851371.674460:0:22764:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788851371.674474:0:22764:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788851371.678260:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87beef00 going to sleep for 11 seconds 00000001:00100000:0.0:1788851371.682512:0:22749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788851371.682547:0:22764:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788851371.682558:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788851371.682808:0:22785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788851371.682813:0:22785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788851371.682834:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.682853:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e827ea600/0x3e0030720b207399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207392 expref: 18 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.682860:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea433d800/0x3e0030720b20745d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207456 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.682867:0:22785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.682905:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea433d800/0x3e0030720b20745d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b207456 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.682920:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ea433d800/0x3e0030720b20745d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b207456 expref: 18 pid: 22764 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851371.682935:0:22785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019847040:0@lo:104: 00000100:00100000:0.0:1788851371.682997:0:22785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788851371.683126:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e827ea600/0x3e0030720b207399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b207392 expref: 18 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.683135:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e827ea600/0x3e0030720b207399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b207392 expref: 18 pid: 22763 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851371.683144:0:22785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019847168:0@lo:104: 00000100:00100000:0.0:1788851371.683180:0:22785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.683195:0:22785:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87bee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851371.683229:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019847040 00000100:00100000:0.0:1788851371.683236:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019847040 00000100:00100000:0.0:1788851371.683268:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019847168 00000100:00100000:0.0:1788851371.683271:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019847168 00000100:00100000:0.0:1788851371.683284:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851371.683293:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+4:22785:x1875746019847040:12345-0@lo:104: 00010000:00010000:0.0:1788851371.683306:0:22753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20745d expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.683361:0:22753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788851371.683366:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+4:22785:x1875746019847040:12345-0@lo:104: Request processed in 75us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851371.683374:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851371.683389:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851371.683395:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+3:22785:x1875746019847168:12345-0@lo:104: 00010000:00010000:0.0:1788851371.683402:0:22753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b207399 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.683434:0:22753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788851371.683438:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+3:22785:x1875746019847168:12345-0@lo:104: Request processed in 45us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851371.683444:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788851371.683459:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851371.683465:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20745d expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.683473:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433cc00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851371.683484:0:22757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20745d expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.683494:0:22757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20745d expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851371.683502:0:22757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20745d expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851371.683508:0:22757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788851371.683533:0:22757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20745d expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.683538:0:22757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851371.683557:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20745d expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.683565:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433cc00/0x3e0030720b207456 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20745d expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.683591:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851371.683595:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b207399 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851371.683963:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851371.683972:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788851371.683985:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3647:1875746019847296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851371.684032:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851371.684075:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019847296 00000100:00100000:2.0:1788851371.684079:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019847296 00010000:00010000:2.0:1788851371.684097:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea433d800/0x3e0030720b20745d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207456 expref: 19 pid: 22764 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851371.684117:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851371.684122:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:3647:x1875746019847296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851371.684131:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851371.684135:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea433d800/0x3e0030720b20745d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207456 expref: 19 pid: 22764 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851371.684145:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea433d800/0x3e0030720b20745d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b207456 expref: 19 pid: 22764 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851371.684160:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851371.684182:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:3647:x1875746019847296:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851371.684196:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851371.684227:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3647:1875746019847296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851371.684514:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433d800/0x3e0030720b20745d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b207456 expref: 18 pid: 22764 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851371.684527:0:22785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019847040:0@lo:104: 00000100:00100000:3.0:1788851371.684537:0:22785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019847168:0@lo:104: 00010000:00010000:3.0:1788851371.684554:0:22785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.684909:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdaaa00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851371.684913:0:22757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b207399 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.684922:0:22757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b207399 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851371.684944:0:22757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b207399 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851371.684949:0:22757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788851371.684976:0:22757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b207399 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.684983:0:22757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851371.685031:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b207399 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685038:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b207392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b207399 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685117:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851371.685120:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851371.685122:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851371.685162:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019847424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851371.685205:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.685253:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019847424 00000100:00100000:0.0:1788851371.685259:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019847424 00010000:00010000:0.0:1788851371.685278:0:22756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e827ea600/0x3e0030720b207399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207392 expref: 18 pid: 22763 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851371.685301:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851371.685309:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:3649:x1875746019847424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851371.685319:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851371.685324:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e827ea600/0x3e0030720b207399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207392 expref: 18 pid: 22763 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685342:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e827ea600/0x3e0030720b207399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b207392 expref: 18 pid: 22763 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685356:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827ea600/0x3e0030720b207399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b207392 expref: 18 pid: 22763 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685369:0:22756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685378:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788851371.685392:0:22756:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011485417s 00010000:00010000:0.0:1788851371.685396:0:22756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685404:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685412:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685418:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685424:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdaa800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851371.685428:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685436:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685455:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685465:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851371.685497:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:3649:x1875746019847424:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851371.685503:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788851371.685525:0:22785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685534:0:22785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851371.685540:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207495 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851371.685566:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019847424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851371.686514:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+16:23502:x1875746019846912:12345-0@lo:253:mount.lustre.0 Request processed in 12077us (12179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851371.686525:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788851371.687729:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:23502:1875746019846912:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788851371.687750:0:23502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788851371.687753:0:23502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788851371.687755:0:23502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788851371.687757:0:23502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851371.687758:0:23502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851371.687760:0:23502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851371.687761:0:23502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851371.687762:0:23502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788851371.687764:0:23502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851371.687765:0:23502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788851371.687783:0:23502:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1788851371.710585:0:23502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788851371.715263:0:23529:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788851371.715290:0:23502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1788851371.716046:0:23529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1788851371.720413:0:23528:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788851371.720422:0:23528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:0.0:1788851371.721772:0:23529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788851371.721852:0:23529:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788851371.723350:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88399880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23530:1875746019847552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788851371.723426:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851371.723482:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87a41a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851371.723537:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019847552 00000100:00100000:2.0:1788851371.723544:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019847552 00000100:00100000:2.0:1788851371.723611:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788851371.723621:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23530:x1875746019847552:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788851371.723718:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23530:x1875746019847552:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 97us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851371.723727:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851371.723818:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88399880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23530:1875746019847552:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788851371.723853:0:23530:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788851371.723882:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88399880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23530:1875746019847680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788851371.723915:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788851371.724210:0:23502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788851371.724263:0:23502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788851371.724672:0:23502:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788851371.724680:0:23502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788851371.724717:0:23502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788851371.726279:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87a41a80 going to sleep for 11 seconds 00000040:00080000:1.0:1788851371.726783:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788851371.727901:0:23502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788851371.727954:0:23502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:2.0:1788851371.728429:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019847680 00000100:00100000:2.0:1788851371.728439:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019847680 00000040:00080000:1.0:1788851371.728863:0:23502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788851371.729627:0:23502:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:1.0:1788851371.732694:0:23502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788851371.733446:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851371.733459:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23530:x1875746019847680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788851371.733672:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23530:x1875746019847680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 216us (9754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851371.733680:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788851371.733800:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88399880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23530:1875746019847680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788851371.733894:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23530:1875746019847808:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788851371.733947:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.733973:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90a9f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788851371.734425:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019847808 00000100:00100000:2.0:1788851371.734432:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019847808 00000100:00100000:2.0:1788851371.734538:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788851371.734547:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23530:x1875746019847808:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788851371.734627:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23530:x1875746019847808:12345-0@lo:900:lod0001_rec0000.0 Request processed in 82us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851371.734634:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788851371.734802:0:23530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff892eb694d880 x1875746019847808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788851387 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851371.734815:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23530:1875746019847808:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788851371.734868:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23530:1875746019847936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788851371.734898:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851371.734966:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90a9fcc0 going to sleep for 11 seconds 00000001:00080000:0.0:1788851371.735269:0:23502:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788851371.735311:0:23502:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa99040e2b988 00100000:10000000:0.0:1788851371.735320:0:23502:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:3.0:1788851371.735416:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019847936 00000100:00100000:3.0:1788851371.735423:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019847936 00000100:00100000:3.0:1788851371.735467:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788851371.735476:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23530:x1875746019847936:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788851371.735555:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23530:x1875746019847936:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 81us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851371.735561:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851371.735660:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23530:1875746019847936:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788851371.735716:0:23530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:0.0:1788851371.736532:0:23502:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788851371.736561:0:23502:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788851371.736592:0:23502:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788851371.736733:0:23502:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:1.0:1788851371.737848:0:23530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788851371.737912:0:23530:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788851371.737917:0:23530:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00000004:0.0:1788851371.739313:0:23502:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788851371.739587:0:23502:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788851372.085315:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851372.598601:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00000040:00080000:3.0:1788851372.727802:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788851372.985502:0:22766:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788851372.985512:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892eb6cf0800 from 12 10000000:01000000:3.0:1788851372.985528:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788851372.985587:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851372.985599:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851372.985627:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851372.985655:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019848064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788851372.985726:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851372.985775:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87a41240 going to sleep for 11 seconds 00000100:00100000:0.0:1788851372.985836:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019848064 00000100:00100000:0.0:1788851372.985849:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019848064 00000100:00100000:0.0:1788851372.985913:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788851372.985922:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+16:22766:x1875746019848064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851372.985935:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851372.985948:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebbdab200/0x3e0030720b2074a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20749c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851372.985973:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebbdab200/0x3e0030720b2074a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20749c expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851372.985996:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebbdab200/0x3e0030720b2074a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20749c expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851372.986007:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdab200, rc 0) 00000100:00100000:0.0:1788851372.986081:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:22766:x1875746019848064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851372.986089:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788851372.986138:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019848064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851372.986152:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074a3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851372.986162:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2074a3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851372.986213:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019848192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788851372.986250:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851372.986263:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90a9f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788851372.986276:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019848192 00000100:00100000:0.0:1788851372.986279:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019848192 00000100:00100000:0.0:1788851372.986298:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788851372.986304:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:22766:x1875746019848192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788851372.986318:0:22764:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788851372.986338:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788851372.986341:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788851372.986425:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:22766:x1875746019848192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851372.986440:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788851372.986470:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019848192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788851372.986508:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788851372.986514:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074a3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851372.986523:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074a3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851372.986532:0:22766:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788851372.986534:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892d89078800 from 12 10000000:01000000:0.0:1788851372.986536:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788851372.986562:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851372.986570:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851372.986578:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851372.986590:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019848320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851372.986613:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851372.986626:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90a9f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788851372.986636:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019848320 00000100:00100000:0.0:1788851372.986639:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019848320 00000100:00100000:0.0:1788851372.986659:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788851372.986664:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8799ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:22766:x1875746019848320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851372.986676:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851372.986684:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebbdab000/0x3e0030720b2074b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2074aa expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851372.986697:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebbdab000/0x3e0030720b2074b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2074aa expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851372.986704:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebbdab000/0x3e0030720b2074b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2074aa expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851372.986711:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdab000, rc 0) 00000100:00100000:0.0:1788851372.986738:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8799ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:22766:x1875746019848320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851372.986743:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788851372.986770:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019848320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851372.986780:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074b1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851372.986787:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2074b1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851372.986820:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019848448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788851372.986844:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851372.986855:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90a9f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788851372.986864:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019848448 00000100:00100000:0.0:1788851372.986867:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019848448 00000100:00100000:0.0:1788851372.986884:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788851372.986889:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:22766:x1875746019848448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788851372.986905:0:22764:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788851372.986914:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788851372.986916:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788851372.986973:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:22766:x1875746019848448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 82us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851372.986979:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788851372.987005:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019848448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788851372.987058:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788851372.987063:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074b1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851372.987071:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074b1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851373.108569:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851373.620110:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00000040:00080000:2.0:1788851373.749795:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788851374.137424:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851374.644666:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00010000:00010000:0.0:1788851375.156225:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851375.669303:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00010000:00010000:2.0:1788851376.180402:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851376.693089:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 0 seconds 00000001:02000400:0.0:1788851376.926164:0:23772:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788851377.080568:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788851377.080575:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788851377.080579:0:8:0:(import.c:65:import_set_state_nolock()) ffff892e91592800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851377.080595:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff892e91592800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851377.080615:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e8707b480 x1875746019848832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851377.080634:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851377.080637:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851377.080640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851377.080644:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851377.080661:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851377.080664:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851377.080666:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851377.080669:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788851377.080698:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3647:1875746019848704:0@lo:400:kworker.0 00000100:00100000:1.0:1788851377.080763:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851377.080810:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851377.080815:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019848960:0@lo:400:kworker.0 00000100:00100000:1.0:1788851377.080845:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851377.080870:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019848832:0@lo:38:kworker.0 00000100:00100000:1.0:1788851377.080903:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851377.080937:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019848960 00000100:00100000:1.0:1788851377.080944:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019848960 00000100:00100000:1.0:1788851377.080986:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788851377.080994:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019848960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851377.081062:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019848960:12345-0@lo:400:kworker.0 Request processed in 69us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851377.081069:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788851377.081091:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019848832 00000100:00100000:1.0:1788851377.081095:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019848832 00000100:00100000:1.0:1788851377.081113:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788851377.081118:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875746019848832:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788851377.081142:0:22774:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00010000:00080000:2.0:1788851377.081167:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e8707aa00 x1875746019848960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851377.081180:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019848960:0@lo:400:kworker.0 00000020:00000080:1.0:1788851377.081224:0:22774:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b2074b8 00000004:00100000:1.0:1788851377.081240:0:22774:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788851377.081246:0:22774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1788851377.081260:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019848576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851377.081288:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851377.081301:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019849216:0@lo:400:kworker.0 00000100:00100000:0.0:1788851377.081318:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851377.081339:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019849216 00000100:00100000:1.0:1788851377.081343:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019849216 00000100:00100000:0.0:1788851377.081344:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788851377.081349:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019849088:0@lo:400:kworker.0 00000100:00100000:1.0:1788851377.081365:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851377.081367:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851377.081371:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019849216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851377.081394:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019848704 00000100:00100000:0.0:1788851377.081398:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019848704 00000100:00100000:1.0:1788851377.081405:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019849216:12345-0@lo:400:kworker.0 Request processed in 34us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851377.081410:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788851377.081429:0:22775:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788851377.081429:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788851377.081435:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8799bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:3647:x1875746019848704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851377.081436:0:22775:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788851377.081480:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8799bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:3647:x1875746019848704:12345-0@lo:400:kworker.0 Request processed in 34us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851377.081486:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788851377.081524:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e8707ad80 x1875746019849216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851377.081533:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019849216:0@lo:400:kworker.0 00000100:00100000:0.0:1788851377.081552:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3647:1875746019848704:0@lo:400:kworker.0 00000100:00100000:0.0:1788851377.081594:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019848576 00000100:00100000:0.0:1788851377.081598:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019848576 00000100:00100000:0.0:1788851377.081614:0:22775:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788851377.081618:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019849088 00000100:00100000:0.0:1788851377.081620:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019849088 00000100:00100000:1.0:1788851377.081663:0:23778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788851377.081671:0:23778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875746019848576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851377.081697:0:23778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788851377.081743:0:23778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875746019848576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851377.081749:0:23778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788851377.081760:0:23778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788851377.081766:0:23778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019849088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851377.081793:0:23778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019849088:12345-0@lo:400:kworker.0 Request processed in 27us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851377.081799:0:23778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788851377.081800:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019849088:0@lo:400:kworker.0 00000100:00100000:3.0:1788851377.081814:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019848576:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788851377.104268:0:22774:0:(import.c:65:import_set_state_nolock()) ffff892d81a1d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851377.104374:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875746019848832:12345-0@lo:38:kworker.0 Request processed in 23252us (23467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851377.104385:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788851377.107111:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788851377.107128:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788851377.107135:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788851377.107138:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e91592800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788851377.107164:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c7fa9b90): req@ffff892e87078a80 x1875746019841792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851377.107192:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019848832:0@lo:38:kworker.0 00000100:00100000:3.0:1788851377.107572:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851377.107587:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019849344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851377.107649:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851377.107690:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019849344 00000100:00100000:3.0:1788851377.107697:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019849344 00000100:00100000:3.0:1788851377.107748:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788851377.107757:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019849344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851377.107791:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788851377.107791:0:22812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851377.107808:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788851377.107821:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019841792 00000100:00100000:0.0:1788851377.107824:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019841792 00000100:00100000:3.0:1788851377.107832:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1875746019849344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851377.107839:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788851377.107842:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788851377.107847:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22812:x1875746019841792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788851377.107872:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019849344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851377.107923:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22812:x1875746019841792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 74us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851377.107929:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788851377.107967:0:22812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1875746019841792:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788851377.107999:0:22812:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788851377.108060:0:22812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1875746019849472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788851377.108091:0:22812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851377.108108:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87a41e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788851377.108149:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019849472 00000100:00100000:0.0:1788851377.108153:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019849472 00000100:00100000:0.0:1788851377.108181:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788851377.108188:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22812:x1875746019849472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788851377.108282:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22812:x1875746019849472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851377.108288:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788851377.108518:0:22812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1875746019849472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788851377.108593:0:22812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1875746019849600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788851377.108626:0:22812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851377.108650:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eacd45480 going to sleep for 11 seconds 00000100:00100000:0.0:1788851377.108697:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019849600 00000100:00100000:0.0:1788851377.108702:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019849600 00000100:00100000:0.0:1788851377.108728:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788851377.108734:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22812:x1875746019849600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788851377.108780:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22812:x1875746019849600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851377.108786:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788851377.109562:0:22812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22812:1875746019849600:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788851377.109618:0:22812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788851377.111637:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788851377.111732:0:22812:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:2.0:1788851377.111739:0:22812:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788851377.214956:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788851378.143733:0:23826:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788851378.144088:0:23826:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788851378.234675:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788851379.209880:0:23877:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851379.210112:0:23877:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788851379.253827:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788851379.770683:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1788851380.262577:0:23925:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec4279b00 20000000:00000080:2.0:1788851380.262597:0:23925:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff892ea7545400 uarg=0000000000000000 20000000:01000000:2.0:1788851380.262637:0:23925:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788851380.262644:0:23925:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788851380.262649:0:23925:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788851380.263591:0:23926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788851380.263781:0:23925:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788851380.269679:0:23925:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788851380.269833:0:23925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851380.269854:0:23925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ea433de00/0x3e0030720b207368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207361 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851380.269863:0:23925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebbdaa400/0x3e0030720b20746b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207464 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851380.269871:0:23925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851380.269921:0:23925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebbdaa400/0x3e0030720b20746b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b207464 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851380.269938:0:23925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ebbdaa400/0x3e0030720b20746b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b207464 expref: 17 pid: 22761 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851380.269954:0:23925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23925:1875746019849728:0@lo:104: 00000100:00100000:3.0:1788851380.270559:0:23925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788851380.270625:0:23925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ea433de00/0x3e0030720b207368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b207361 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851380.270635:0:23925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ea433de00/0x3e0030720b207368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b207361 expref: 17 pid: 22761 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851380.270666:0:23925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88398700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23925:1875746019849856:0@lo:104: 00000100:00100000:3.0:1788851380.270697:0:23925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851380.270799:0:23925:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87a41180 going to sleep for 11 seconds 00000100:00100000:2.0:1788851380.270912:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019849728 00000100:00100000:2.0:1788851380.270920:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019849728 00000100:00100000:2.0:1788851380.270965:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019849856 00000100:00100000:2.0:1788851380.270969:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019849856 00000100:00100000:2.0:1788851380.270982:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788851380.270992:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+4:23925:x1875746019849728:12345-0@lo:104: 00010000:00010000:2.0:1788851380.271005:0:22753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20746b expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851380.271353:0:22753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788851380.271366:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+4:23925:x1875746019849728:12345-0@lo:104: Request processed in 375us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851380.271373:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788851380.271392:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788851380.271399:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+3:23925:x1875746019849856:12345-0@lo:104: 00010000:00010000:2.0:1788851380.271420:0:22753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b207368 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851380.271526:0:23925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23925:1875746019849728:0@lo:104: 00000100:00100000:3.0:1788851380.271537:0:23925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88398700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23925:1875746019849856:0@lo:104: 00010000:00010000:3.0:1788851380.271556:0:23925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.271724:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851380.271733:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20746b expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.271740:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab400 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851380.271744:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20746b expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.271754:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20746b expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851380.271762:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20746b expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851380.271780:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788851380.271829:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20746b expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.271836:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851380.271866:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20746b expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.271874:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebbdab400/0x3e0030720b207464 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20746b expref: -99 pid: 23502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.271885:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851380.271888:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b207368 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.271893:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95c00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:0.0:1788851380.271896:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b207368 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.271903:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b207368 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851380.271910:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b207368 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851380.271915:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788851380.271940:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b207368 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.271946:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851380.271969:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b207368 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.271976:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebff95c00/0x3e0030720b207361 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b207368 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.271989:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851380.271990:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851380.271992:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851380.272001:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851380.272026:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3647:1875746019849984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851380.272060:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851380.272094:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019850112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851380.272116:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851380.272148:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019849984 00000100:00100000:0.0:1788851380.272153:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019849984 00010000:00010000:0.0:1788851380.272173:0:22756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebbdaa400/0x3e0030720b20746b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207464 expref: 18 pid: 22761 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851380.272194:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019850112 00000100:00100000:0.0:1788851380.272197:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019850112 00010000:00010000:0.0:1788851380.272208:0:22756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ea433de00/0x3e0030720b207368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207361 expref: 19 pid: 22761 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851380.272221:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851380.272227:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:3647:x1875746019849984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851380.272397:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851380.272405:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebbdaa400/0x3e0030720b20746b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207464 expref: 19 pid: 22761 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272437:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebbdaa400/0x3e0030720b20746b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b207464 expref: 19 pid: 22761 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272451:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebbdaa400/0x3e0030720b20746b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b207464 expref: 19 pid: 22761 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272463:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851380.272535:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:3647:x1875746019849984:12345-0@lo:103:ldlm_bl.0 Request processed in 308us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851380.272543:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851380.272558:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851380.272565:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:3649:x1875746019850112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851380.272574:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851380.272578:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ea433de00/0x3e0030720b207368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207361 expref: 17 pid: 22761 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272587:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ea433de00/0x3e0030720b207368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b207361 expref: 17 pid: 22761 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272597:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433de00/0x3e0030720b207368 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b207361 expref: 17 pid: 22761 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272606:0:22756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272614:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272628:0:22756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272640:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272648:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272655:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272660:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433cc00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851380.272664:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272672:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272686:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.272696:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851380.272725:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+16:3649:x1875746019850112:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851380.272732:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851380.272766:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019850112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851380.272904:0:22753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788851380.272912:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+3:23925:x1875746019849856:12345-0@lo:104: Request processed in 1513us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851380.272918:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788851380.272965:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851380.272995:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3647:1875746019849984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851380.273135:0:23925:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851380.273145:0:23925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851380.273152:0:23925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ea433cc00/0x3e0030720b2074bf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851380.279524:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851381.173484:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851371/real 1788851371] req@ffff892eb694f800 x1875746019844992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851381 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851381.173516:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892eb694f800 x1875746019844992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851381 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851381.173528:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851371/real 1788851371] req@ffff892d88398000 x1875746019844864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851381 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851381.173558:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892d88398000 x1875746019844864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851381 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788851381.173577:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e90e54000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851381.173601:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788851381.173606:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019844992:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788851381.173613:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e87c1f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851381.173618:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788851381.173621:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019844864:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788851381.173840:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851381.173845:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788851381.173848:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851381.173851:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788851381.173867:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851381.173870:0:23321:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788851381.173872:0:23321:0:(import.c:65:import_set_state_nolock()) ffff892e87c1f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851381.173886:0:23321:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 705 00000100:00080000:3.0:1788851381.173893:0:23321:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788851381.173904:0:23321:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff892e87c1f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851381.173926:0:23321:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d8839b800 x1875746019850752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851381.173947:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851381.173951:0:23321:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788851381.173953:0:23321:0:(import.c:65:import_set_state_nolock()) ffff892e90e54000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851381.173956:0:23321:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 705 00000100:00080000:3.0:1788851381.173958:0:23321:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788851381.173963:0:23321:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892e90e54000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851381.173975:0:23321:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d88399880 x1875746019850880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851381.174032:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019850624:0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.174143:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851381.174191:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788851381.174197:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019850240:0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.174228:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851381.174253:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019851008:0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.174297:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851381.174325:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019850368:0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.174366:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851381.174409:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851381.174416:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019850496:0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.174437:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851381.174483:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019850624 00000100:00100000:3.0:1788851381.174492:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019850624 00000100:00100000:3.0:1788851381.174537:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019850368 00000100:00100000:3.0:1788851381.174540:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019850368 00000100:00100000:3.0:1788851381.174557:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788851381.174566:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019850624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.174625:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019850624:12345-0@lo:400:kworker.0 Request processed in 60us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851381.174632:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788851381.174649:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788851381.174655:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875746019850368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.174702:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875746019850368:12345-0@lo:400:kworker.0 Request processed in 47us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851381.174708:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788851381.174725:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019850240 00000100:00100000:3.0:1788851381.174729:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019850240 00000100:00100000:3.0:1788851381.174755:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788851381.174761:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+16:3649:x1875746019850240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.174787:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+16:3649:x1875746019850240:12345-0@lo:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851381.174793:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788851381.174833:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019851008 00000100:00100000:3.0:1788851381.174838:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019851008 00000100:00100000:3.0:1788851381.174862:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019850496 00000100:00100000:3.0:1788851381.174865:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019850496 00000100:00100000:3.0:1788851381.174877:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788851381.174883:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019851008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.174913:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019851008:12345-0@lo:400:kworker.0 Request processed in 30us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851381.174927:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788851381.174938:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851381.174943:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019850496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.174970:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019850496:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851381.174975:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788851381.175038:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892d88398000 x1875746019850496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851381.175053:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019850496:0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.175064:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019850368:0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.175088:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019850752:0@lo:8:kworker.0 00000400:00000100:3.0:1788851381.175124:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019850752 offset 0 length 520: 4 00000100:00100000:3.0:1788851381.175144:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019850880:0@lo:8:kworker.0 00000400:00000100:3.0:1788851381.175162:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019850880 offset 0 length 520: 4 00000100:00100000:3.0:1788851381.175190:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019850240:0@lo:400:kworker.0 00010000:00080000:3.0:1788851381.175199:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892d8839ad80 x1875746019851008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851381.175208:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019851008:0@lo:400:kworker.0 00000100:00100000:3.0:1788851381.175218:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019850624:0@lo:400:kworker.0 00010000:00010000:1.0:1788851381.306412:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788851381.306596:0:22766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788851381.306600:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892eb6cf0800 from 13 10000000:01000000:0.0:1788851381.306604:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851381.308166:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851381.308189:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851381.308203:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851381.308231:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019851136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851381.308301:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851381.308358:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788851381.308565:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019851136 00000100:00100000:1.0:1788851381.308574:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019851136 00000100:00100000:1.0:1788851381.308627:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788851381.308637:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8799b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+16:22766:x1875746019851136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851381.308666:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851381.308685:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e827eb800/0x3e0030720b2074cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2074c6 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851381.308709:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e827eb800/0x3e0030720b2074cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2074c6 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851381.308720:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e827eb800/0x3e0030720b2074cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2074c6 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851381.308730:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e827eb800, rc 0) 00000100:00100000:1.0:1788851381.308781:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8799b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:22766:x1875746019851136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851381.308793:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788851381.308971:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019851136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851381.308986:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074cd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851381.308995:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2074cd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851381.309098:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019851264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851381.309127:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851381.309140:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788851381.309255:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019851264 00000100:00100000:1.0:1788851381.309260:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019851264 00000100:00100000:1.0:1788851381.309284:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788851381.309291:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8799a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:22766:x1875746019851264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851381.309546:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8799a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:22766:x1875746019851264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851381.309554:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788851381.309773:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019851264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851381.309808:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019851392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851381.309848:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851381.309881:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e81690cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851381.311447:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019851392 00000100:00100000:1.0:1788851381.311460:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019851392 00000100:00100000:1.0:1788851381.311513:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788851381.311522:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:22766:x1875746019851392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851381.311682:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:22766:x1875746019851392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851381.311690:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788851381.311754:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019851392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788851381.312456:0:23980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788851381.312519:0:22766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788851381.312542:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851381.312552:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074cd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851381.312563:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074cd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851381.312573:0:22766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788851381.312584:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892d89078800 from 13 10000000:01000000:1.0:1788851381.312587:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788851381.312622:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851381.312631:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851381.312640:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851381.312662:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019851520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788851381.312726:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851381.312756:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead218cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851381.312847:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019851520 00000100:00100000:1.0:1788851381.312853:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019851520 00000100:00100000:1.0:1788851381.312881:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788851381.312887:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8799a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+17:22766:x1875746019851520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851381.312898:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851381.312909:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e827ea000/0x3e0030720b2074db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2074d4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851381.312931:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e827ea000/0x3e0030720b2074db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2074d4 expref: 18 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851381.312942:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e827ea000/0x3e0030720b2074db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2074d4 expref: 18 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851381.312950:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e827ea000, rc 0) 00000100:00100000:1.0:1788851381.312981:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8799a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:22766:x1875746019851520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851381.312993:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788851381.313050:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019851520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851381.313065:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074db expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851381.313074:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2074db expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851381.313120:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019851648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851381.313144:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851381.313158:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead218cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851381.313169:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019851648 00000100:00100000:1.0:1788851381.313172:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019851648 00000100:00100000:1.0:1788851381.313193:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788851381.313199:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8799b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:22766:x1875746019851648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851381.313290:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8799b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:22766:x1875746019851648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851381.313297:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788851381.313330:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019851648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851381.313353:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019851776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851381.313402:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851381.313416:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead218cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851381.313426:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019851776 00000100:00100000:1.0:1788851381.313428:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019851776 00000100:00100000:1.0:1788851381.313448:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788851381.313459:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:22766:x1875746019851776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851381.313525:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:22766:x1875746019851776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851381.313531:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788851381.313568:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019851776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788851381.327309:0:23981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788851381.327519:0:22766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788851381.327548:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788851381.327561:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074db expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851381.327585:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074db expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851382.196629:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851367/real 1788851367] req@ffff892e8707a680 x1875746019842816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851382 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851382.199185:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892e8707a680 x1875746019842816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851382 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851382.199204:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851367/real 1788851367] req@ffff892e8707b100 x1875746019842944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851382 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851382.199221:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892e8707b100 x1875746019842944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851382 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788851382.199243:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c57800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851382.199264:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788851382.199268:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019842816:0@lo:8:kworker.0 00000100:00080000:3.0:1788851382.199274:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eb6998800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851382.199279:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788851382.199282:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019842944:0@lo:8:kworker.0 00000100:00100000:3.0:1788851382.199558:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019851904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851382.199623:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788851382.199709:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851382.199713:0:23321:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788851382.199715:0:23321:0:(import.c:65:import_set_state_nolock()) ffff892d85c57800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851382.199728:0:23321:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 701 00000100:00080000:3.0:1788851382.199733:0:23321:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788851382.199743:0:23321:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff892d85c57800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851382.199763:0:23321:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7764700 x1875746019852160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851382.199776:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851382.199779:0:23321:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788851382.199781:0:23321:0:(import.c:65:import_set_state_nolock()) ffff892eb6998800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851382.199784:0:23321:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 701 00000100:00080000:3.0:1788851382.199786:0:23321:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788851382.199790:0:23321:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff892eb6998800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851382.199800:0:23321:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea7767800 x1875746019852288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851382.199842:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851382.199845:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788851382.199848:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851382.199851:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788851382.199879:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019851904 00000100:00100000:3.0:1788851382.199886:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019851904 00000100:00100000:3.0:1788851382.199929:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788851382.199937:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875746019851904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851382.199972:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788851382.200090:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875746019851904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851382.200106:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788851382.200127:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3648:1875746019852032:0@lo:400:kworker.0 00000100:00100000:3.0:1788851382.200158:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851382.200186:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851382.200191:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019852672:0@lo:400:kworker.0 00000100:00100000:3.0:1788851382.200213:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851382.200251:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019851904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851382.200265:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019852416:0@lo:400:kworker.0 00000100:00100000:3.0:1788851382.200285:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851382.201774:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851382.201790:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019852544:0@lo:400:kworker.0 00000100:00100000:3.0:1788851382.201842:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851382.201899:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019852544 00000100:00100000:3.0:1788851382.201905:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019852544 00000100:00100000:3.0:1788851382.201945:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788851382.201954:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019852544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851382.202003:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019852544:12345-0@lo:400:kworker.0 Request processed in 50us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851382.202010:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788851382.202048:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019852672 00000100:00100000:3.0:1788851382.202052:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019852672 00000100:00100000:0.0:1788851382.207004:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019852032 00000100:00100000:0.0:1788851382.207040:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019852032 00000100:00100000:0.0:1788851382.207095:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788851382.207105:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:3648:x1875746019852032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851382.207204:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:3648:x1875746019852032:12345-0@lo:400:kworker.0 Request processed in 101us (7045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851382.207223:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788851382.207455:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3648:1875746019852032:0@lo:400:kworker.0 00000100:00100000:3.0:1788851382.207483:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019852416 00000100:00100000:3.0:1788851382.207487:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019852416 00000100:00100000:3.0:1788851382.207506:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851382.207520:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019852672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851382.207561:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019852672:12345-0@lo:400:kworker.0 Request processed in 41us (7347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851382.207567:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851382.207581:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851382.207586:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019852416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851382.207614:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019852416:12345-0@lo:400:kworker.0 Request processed in 28us (7328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851382.207620:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851382.207675:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019852544:0@lo:400:kworker.0 00010000:00080000:3.0:1788851382.207690:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892ea7765500 x1875746019852416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851382.207701:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019852416:0@lo:400:kworker.0 00010000:00080000:3.0:1788851382.207726:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892ea7765c00 x1875746019852672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851382.207735:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019852672:0@lo:400:kworker.0 00000100:00100000:3.0:1788851382.207770:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019852160:0@lo:8:kworker.0 00000400:00000100:3.0:1788851382.207800:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019852160 offset 0 length 520: 4 00000100:00100000:3.0:1788851382.207826:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019852288:0@lo:8:kworker.0 00000400:00000100:3.0:1788851382.207844:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019852288 offset 0 length 520: 4 00000100:00100000:1.0:1788851382.208117:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019852800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851382.208150:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851382.208182:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019852800 00000100:00100000:1.0:1788851382.208186:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019852800 00000100:00100000:1.0:1788851382.208211:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788851382.208218:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019852800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851382.208247:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788851382.208282:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019852800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851382.208289:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788851382.208341:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019852800:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788851382.326711:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788851382.713198:0:23503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788851383.349196:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851383.989847:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788851384.373433:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851385.397976:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851386.421707:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788851387.066854:0:24274:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788851387.066859:0:24274:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788851387.066861:0:24274:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788851387.066987:0:24274:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff892e983ab800 00000020:01000004:2.0:1788851387.067006:0:24274:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788851387.067136:0:24274:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788851387.067158:0:24274:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff892d85f23380) 00000020:00000080:2.0:1788851387.067186:0:24274:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788851387.126090:0:24274:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788851387.127706:0:24274:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788851387.128369:0:24274:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788851387.128843:0:24274:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788851387.129109:0:24274:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788851387.129446:0:24274:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788851387.129634:0:24274:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1788851387.131787:0:24274:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788851387.132143:0:24274:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788851387.132159:0:24274:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788851387.132174:0:24274:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e0030720b2074e9 00000020:01000004:0.0:1788851387.132182:0:24274:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788851387.132221:0:24274:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788851387.132225:0:24274:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788851387.132231:0:24274:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788851387.132237:0:24274:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788851387.132249:0:24274:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff892eaca08000) 00000020:00000080:0.0:1788851387.132261:0:24274:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788851387.133749:0:24274:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788851387.133940:0:24274:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788851387.133946:0:24274:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788851387.142626:0:24274:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788851387.142647:0:24274:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788851387.145999:0:24274:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788851387.146040:0:24274:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788851387.148612:0:24274:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851387.148813:0:24274:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788851387.148821:0:24274:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788851387.150381:0:24274:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788851387.150392:0:24274:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788851387.171546:0:24274:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851387.171815:0:24274:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788851387.171823:0:24274:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788851387.173623:0:24274:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788851387.173644:0:24274:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788851387.174841:0:24274:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788851387.174852:0:24274:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788851387.179478:0:24274:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851387.179712:0:24274:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788851387.179719:0:24274:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788851387.180607:0:24274:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788851387.180616:0:24274:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788851387.214739:0:24274:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788851387.214969:0:24274:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788851387.214976:0:24274:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788851387.221121:0:24274:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788851387.221137:0:24274:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788851387.225239:0:24274:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788851387.225284:0:24274:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788851387.225292:0:24274:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788851387.249002:0:24274:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788851387.252536:0:24274:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788851387.252544:0:24274:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788851387.252545:0:24274:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788851387.252547:0:24274:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851387.252548:0:24274:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851387.252549:0:24274:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851387.252551:0:24274:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851387.252552:0:24274:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851387.252554:0:24274:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851387.252556:0:24274:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788851387.252560:0:24274:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788851387.252562:0:24274:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788851387.252563:0:24274:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788851387.252564:0:24274:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851387.252572:0:24274:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851387.252573:0:24274:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851387.252574:0:24274:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851387.252575:0:24274:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851387.252576:0:24274:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851387.252577:0:24274:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788851387.252608:0:24274:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788851387.252630:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019852928:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788851387.252717:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851387.252762:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8533a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788851387.252839:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019852928 00000100:00100000:3.0:1788851387.252853:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019852928 00000100:00100000:3.0:1788851387.252909:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788851387.252918:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:24274:x1875746019852928:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788851387.252955:0:22764:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788851387.252958:0:22764:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788851387.252962:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788851387.253518:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:24274:x1875746019852928:12345-0@lo:253:mount.lustre.0 Request processed in 599us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.253527:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788851387.253635:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019852928:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788851387.253646:0:24274:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788851387.253649:0:24274:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788851387.253650:0:24274:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788851387.253652:0:24274:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851387.253653:0:24274:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851387.253654:0:24274:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851387.253655:0:24274:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851387.253657:0:24274:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851387.253658:0:24274:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851387.253659:0:24274:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788851387.253681:0:24274:0:(tgt_mount.c:101:server_register_mount()) register mount ffff892e983ab800 from lustre-OST0000 10000000:01000000:1.0:1788851387.253712:0:24274:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788851387.253714:0:24274:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788851387.253722:0:24274:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff892ead6d8000 local copy 00010000:00010000:1.0:1788851387.253732:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851387.253819:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851387.253847:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851387.253882:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8533a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851387.259152:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019853056 00000100:00100000:3.0:1788851387.259168:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019853056 00000100:00100000:3.0:1788851387.259252:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788851387.259263:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:24274:x1875746019853056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851387.259435:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:24274:x1875746019853056:12345-0@lo:501:mount.lustre.0 Request processed in 173us (5587us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788851387.259444:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788851387.259598:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853056:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788851387.259625:0:24274:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788851387.259670:0:24274:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788851387.259679:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851387.259690:0:24274:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851387.259725:0:24274:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff892e983ab800 10000000:01000000:1.0:1788851387.259730:0:24274:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788851387.259737:0:24274:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788851387.259739:0:24274:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788851387.259743:0:24274:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788851387.259746:0:24274:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788851387.259780:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eba00/0x3e0030720b2074f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851387.259788:0:24274:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827eba00/0x3e0030720b2074f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851387.259797:0:24274:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827eba00/0x3e0030720b2074f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851387.259818:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851387.259854:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851387.259888:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8533a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851387.260126:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019853184 00000100:00100000:3.0:1788851387.260133:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019853184 00000100:00100000:3.0:1788851387.260172:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788851387.260180:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+18:24274:x1875746019853184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851387.260191:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851387.260603:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433d800/0x3e0030720b2074fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2074f7 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.260633:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433d800/0x3e0030720b2074fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2074f7 expref: 19 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.260644:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433d800/0x3e0030720b2074fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2074f7 expref: 19 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.260665:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d800, rc 0) 00000100:00100000:3.0:1788851387.260716:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:24274:x1875746019853184:12345-0@lo:101:mount.lustre.0 Request processed in 537us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.260724:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788851387.260822:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851387.260839:0:24274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827eba00/0x3e0030720b2074f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074fe expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851387.260860:0:24274:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827eba00/0x3e0030720b2074f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2074fe expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851387.262146:0:24274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788851387.263191:0:24274:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788851387.265229:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788851387.265292:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788851387.265311:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788851387.265327:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788851387.265342:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788851387.265377:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788851387.265395:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788851387.265592:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788851387.265611:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788851387.265624:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788851387.265637:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788851387.265650:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788851387.265676:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788851387.265682:0:24274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788851387.265787:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851387.265852:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851387.265903:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8533a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788851387.266078:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019853312 00000100:00100000:0.0:1788851387.266086:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019853312 00000100:00100000:0.0:1788851387.266131:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788851387.266148:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:24274:x1875746019853312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851387.266315:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:24274:x1875746019853312:12345-0@lo:501:mount.lustre.0 Request processed in 168us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851387.266323:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788851387.266535:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851387.266572:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851387.266612:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851387.266643:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788851387.266739:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019853440 00000100:00100000:3.0:1788851387.266744:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019853440 00000100:00100000:3.0:1788851387.266777:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788851387.266785:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:24274:x1875746019853440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851387.267455:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:24274:x1875746019853440:12345-0@lo:503:mount.lustre.0 Request processed in 670us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.267464:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788851387.267560:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788851387.267991:0:24274:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788851387.268115:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851387.268158:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851387.268184:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788851387.268532:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019853568 00000100:00100000:0.0:1788851387.268539:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019853568 00000100:00100000:0.0:1788851387.268585:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788851387.268594:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:24274:x1875746019853568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851387.269121:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:24274:x1875746019853568:12345-0@lo:502:mount.lustre.0 Request processed in 526us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851387.269130:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788851387.269228:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851387.269515:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788851387.269544:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788851387.269559:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788851387.269572:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788851387.269585:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788851387.269598:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788851387.269610:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788851387.269622:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788851387.269634:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788851387.269646:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788851387.269658:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788851387.269670:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788851387.269700:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7765c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851387.269743:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851387.269789:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81e13f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788851387.269978:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019853696 00000100:00100000:0.0:1788851387.269984:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019853696 00000100:00100000:0.0:1788851387.270066:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788851387.270074:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:24274:x1875746019853696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851387.270158:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:24274:x1875746019853696:12345-0@lo:502:mount.lustre.0 Request processed in 84us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851387.270165:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788851387.270436:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7765c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851387.270485:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788851387.270495:0:24274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788851387.274743:0:24291:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788851387.274756:0:24291:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788851387.274763:0:24291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.274766:0:24291:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788851387.274773:0:24291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788851387.274789:0:24291:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff892eb6f40000) 00000020:00000080:1.0:1788851387.274814:0:24291:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788851387.274819:0:24291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788851387.274906:0:24291:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892e983ab800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788851387.274914:0:24291:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788851387.274921:0:24291:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e0030720b20750c 00010000:00010000:1.0:1788851387.280930:0:24291:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788851387.283619:0:24291:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1788851387.287668:0:24291:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788851387.305577:0:24291:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788851387.305591:0:24291:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851387.305598:0:24291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.305600:0:24291:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788851387.305604:0:24291:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788851387.305606:0:24291:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788851387.305608:0:24291:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788851387.305610:0:24291:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788851387.305612:0:24291:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788851387.305614:0:24291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.305616:0:24291:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788851387.305618:0:24291:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851387.305622:0:24291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.305623:0:24291:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788851387.305626:0:24291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788851387.305628:0:24291:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788851387.305630:0:24291:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851387.305632:0:24291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.305633:0:24291:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788851387.305636:0:24291:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851387.305638:0:24291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.305639:0:24291:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788851387.305642:0:24291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788851387.305674:0:24291:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851387.305677:0:24291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.305679:0:24291:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788851387.305682:0:24291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1788851387.305899:0:24274:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788851387.305933:0:24274:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788851387.305961:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eba00/0x3e0030720b2074f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074fe expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.305974:0:24274:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827eba00/0x3e0030720b2074f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2074fe expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851387.305984:0:24274:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892e983ab800 from 1 10000000:01000000:0.0:1788851387.305996:0:24274:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851387.306063:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.306074:0:24274:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.306086:0:24274:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851387.306110:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788851387.306179:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851387.306236:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019853824 00000100:00100000:0.0:1788851387.306246:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019853824 00000100:00100000:0.0:1788851387.306302:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788851387.306312:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:24274:x1875746019853824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851387.306324:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851387.306336:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebbdaac00/0x3e0030720b20751a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207513 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.306359:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebbdaac00/0x3e0030720b20751a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207513 expref: 20 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.306371:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebbdaac00/0x3e0030720b20751a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207513 expref: 20 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.306380:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdaac00, rc 0) 00000100:00100000:0.0:1788851387.306416:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:24274:x1875746019853824:12345-0@lo:101:mount.lustre.0 Request processed in 105us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851387.306422:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788851387.306473:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788851387.306494:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851387.306507:0:24274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20751a expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.306516:0:24274:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20751a expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851387.308157:0:24274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788851387.308614:0:24274:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851387.308818:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788851387.308842:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788851387.308856:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788851387.308868:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788851387.308881:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788851387.308894:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788851387.308906:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788851387.308931:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788851387.308945:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788851387.308959:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788851387.308971:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788851387.308988:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788851387.308993:0:24274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788851387.309443:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851387.309514:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851387.310414:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851387.312091:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019853952 00000100:00100000:3.0:1788851387.312106:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019853952 00000100:00100000:3.0:1788851387.312163:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788851387.312173:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:24274:x1875746019853952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851387.312635:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:24274:x1875746019853952:12345-0@lo:501:mount.lustre.0 Request processed in 463us (3121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.312644:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788851387.312788:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019853952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851387.312859:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019854080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851387.312914:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851387.312952:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf240 going to sleep for 11 seconds 00000100:00100000:1.0:1788851387.313001:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019854080 00000100:00100000:1.0:1788851387.313040:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019854080 00000100:00100000:1.0:1788851387.313070:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788851387.313077:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:24274:x1875746019854080:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851387.313172:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:24274:x1875746019854080:12345-0@lo:503:mount.lustre.0 Request processed in 95us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851387.313180:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788851387.313500:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019854080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788851387.313915:0:24274:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788851387.313996:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7765c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019854208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851387.314090:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851387.314122:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81e130c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851387.314191:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019854208 00000100:00100000:2.0:1788851387.314198:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019854208 00000100:00100000:2.0:1788851387.314245:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788851387.314253:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:24274:x1875746019854208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851387.314352:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:24274:x1875746019854208:12345-0@lo:502:mount.lustre.0 Request processed in 100us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851387.314359:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788851387.314533:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7765c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019854208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851387.314700:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788851387.314726:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788851387.314739:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788851387.314753:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788851387.314767:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788851387.314779:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788851387.314792:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788851387.314805:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788851387.314818:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788851387.314830:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788851387.314852:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788851387.314872:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7765c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019854336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851387.314907:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851387.314937:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81e130c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851387.314986:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019854336 00000100:00100000:2.0:1788851387.314990:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019854336 00000100:00100000:2.0:1788851387.315051:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788851387.315059:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:24274:x1875746019854336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851387.315135:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:24274:x1875746019854336:12345-0@lo:502:mount.lustre.0 Request processed in 77us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851387.315142:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788851387.315237:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7765c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019854336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788851387.315292:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788851387.315301:0:24274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788851387.317675:0:24295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851387.317690:0:24295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.317692:0:24295:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788851387.317700:0:24295:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892e983ab800 00000020:00000080:1.0:1788851387.317702:0:24295:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851387.317710:0:24295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851387.317712:0:24295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.317714:0:24295:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788851387.317716:0:24295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851387.317718:0:24295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.317719:0:24295:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788851387.317722:0:24295:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892e983ab800 00000020:00000080:1.0:1788851387.317723:0:24295:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851387.317782:0:24295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851387.317786:0:24295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.317787:0:24295:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788851387.317789:0:24295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851387.317791:0:24295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.317792:0:24295:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788851387.317795:0:24295:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892e983ab800 00000020:00000080:1.0:1788851387.317797:0:24295:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851387.317810:0:24295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851387.317831:0:24295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.317832:0:24295:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788851387.317835:0:24295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851387.317838:0:24295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.317839:0:24295:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788851387.317842:0:24295:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892e983ab800 00000020:00000080:1.0:1788851387.317843:0:24295:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851387.317864:0:24295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851387.317867:0:24295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851387.317868:0:24295:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788851387.317871:0:24295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788851387.317981:0:24274:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788851387.318040:0:24274:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851387.318055:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20751a expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851387.318068:0:24274:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20751a expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851387.318126:0:24274:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788851387.318130:0:24274:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff892e983ab800 10000000:01000000:1.0:1788851387.318133:0:24274:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff892e983ab800 10000000:01000000:1.0:1788851387.318137:0:24274:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788851387.318142:0:24274:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892e983ab800 from 1 10000000:01000000:1.0:1788851387.318145:0:24274:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788851387.318183:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b207521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851387.318192:0:24274:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b207521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851387.318488:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019854592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851387.318554:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851387.318588:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851387.318593:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019854720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851387.318615:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851387.318653:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019854592 00000100:00100000:3.0:1788851387.318658:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019854592 00000100:00100000:3.0:1788851387.318692:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019854720 00000100:00100000:3.0:1788851387.318695:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019854720 00000100:00100000:3.0:1788851387.318709:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788851387.318717:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019854592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851387.318747:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788851387.318792:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019854592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.318800:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788851387.318815:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788851387.318821:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019854720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851387.318839:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788851387.318864:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019854720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.318869:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788851387.318912:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019854720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851387.318924:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019854592:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788851387.322309:0:24274:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b207521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788851387.322361:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851387.322366:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851387.322369:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851387.322372:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851387.322417:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851387.322420:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851387.322423:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851387.322426:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788851387.323540:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019854848:0@lo:400:kworker.0 00000100:00100000:1.0:1788851387.323623:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851387.323672:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851387.323680:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019854976:0@lo:400:kworker.0 00000100:00100000:1.0:1788851387.323706:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851387.323749:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019854464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851387.323783:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851387.323816:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019854464 00000100:00100000:1.0:1788851387.323824:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019854464 00000100:00100000:1.0:1788851387.323876:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788851387.323884:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:24274:x1875746019854464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851387.323900:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851387.323922:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e827eaa00/0x3e0030720b207528 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207521 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851387.323975:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e827eaa00/0x3e0030720b207528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207521 expref: 21 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851387.323988:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e827eaa00/0x3e0030720b207528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207521 expref: 21 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851387.323999:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e827eaa00, rc 0) 00000100:00100000:1.0:1788851387.324070:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019854464:12345-0@lo:101:mount.lustre.0 Request processed in 186us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851387.324077:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788851387.324123:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851387.324143:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019854464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851387.324157:0:24274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b207521 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207528 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851387.324167:0:24274:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b207521 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b207528 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851387.325366:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019854848 00000100:00100000:3.0:1788851387.325378:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019854848 00000100:00100000:3.0:1788851387.325418:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019854976 00000100:00100000:3.0:1788851387.325421:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019854976 00000100:00100000:3.0:1788851387.325436:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788851387.325444:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019854848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851387.325518:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019854848:12345-0@lo:400:kworker.0 Request processed in 75us (1896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.325524:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788851387.325541:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788851387.325547:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019854976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851387.325575:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019854976:12345-0@lo:400:kworker.0 Request processed in 29us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.325580:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788851387.325628:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e8707a680 x1875746019854976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851387.325644:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019854976:0@lo:400:kworker.0 00010000:00080000:3.0:1788851387.325659:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e8707b100 x1875746019854848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851387.325668:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019854848:0@lo:400:kworker.0 00000040:00080000:2.0:1788851387.341368:0:24274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788851387.341750:0:24274:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788851387.341985:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788851387.342074:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788851387.342096:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788851387.342112:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788851387.342126:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788851387.342138:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788851387.342151:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788851387.342163:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788851387.342178:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788851387.342193:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788851387.342551:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788851387.342570:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788851387.342583:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788851387.342596:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788851387.342610:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788851387.342623:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788851387.342637:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788851387.342651:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788851387.342664:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788851387.342679:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788851387.342693:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788851387.342707:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788851387.342721:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788851387.342736:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788851387.342749:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788851387.342763:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788851387.342793:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788851387.342809:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788851387.342823:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788851387.342837:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788851387.342849:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788851387.342862:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788851387.342874:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788851387.346462:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788851387.346501:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788851387.346513:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788851387.346524:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788851387.346535:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788851387.346548:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788851387.346562:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788851387.346575:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788851387.346587:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788851387.346615:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788851387.346629:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788851387.346641:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788851387.346654:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788851387.346666:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788851387.346676:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788851387.346853:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788851387.346875:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788851387.346896:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788851387.346902:0:24274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788851387.347039:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019855104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851387.347118:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851387.347173:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86ae7600 going to sleep for 11 seconds 00000100:00100000:3.0:1788851387.348359:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019855104 00000100:00100000:3.0:1788851387.348373:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019855104 00000100:00100000:3.0:1788851387.348436:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788851387.348448:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019855104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851387.348624:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019855104:12345-0@lo:501:mount.lustre.0 Request processed in 178us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.348639:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788851387.349457:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019855104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851387.349517:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019855232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851387.349573:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851387.349600:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86ae7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788851387.349735:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019855232 00000100:00100000:1.0:1788851387.349741:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019855232 00000100:00100000:1.0:1788851387.349779:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788851387.349787:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019855232:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851387.349883:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019855232:12345-0@lo:503:mount.lustre.0 Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851387.349891:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788851387.350135:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019855232:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788851387.351657:0:24274:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788851387.351743:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019855360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851387.351814:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851387.351858:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86ae7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788851387.352098:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019855360 00000100:00100000:1.0:1788851387.352111:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019855360 00000100:00100000:1.0:1788851387.352152:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788851387.352160:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019855360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851387.352290:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019855360:12345-0@lo:502:mount.lustre.0 Request processed in 129us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851387.352297:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788851387.352461:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019855360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851387.352638:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788851387.352664:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788851387.352676:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788851387.352688:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788851387.352701:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788851387.352727:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788851387.352739:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788851387.352750:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788851387.352761:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788851387.352772:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788851387.352784:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788851387.352796:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788851387.352809:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788851387.352821:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788851387.352834:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788851387.352847:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788851387.352858:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788851387.352868:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788851387.352878:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788851387.352887:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788851387.352898:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788851387.352922:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788851387.352936:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788851387.352948:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788851387.352960:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788851387.352973:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788851387.352986:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788851387.352999:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788851387.355373:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788851387.355400:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788851387.355415:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788851387.355428:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788851387.355442:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788851387.355456:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788851387.355468:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788851387.355481:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788851387.355495:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788851387.355529:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788851387.355545:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788851387.355559:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788851387.355572:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788851387.357395:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788851387.357429:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788851387.357440:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788851387.357453:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788851387.357465:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788851387.357477:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788851387.357489:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788851387.357551:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019855488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851387.357647:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851387.357698:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019855488 00000100:00100000:2.0:1788851387.357706:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019855488 00000100:00100000:2.0:1788851387.357755:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788851387.357764:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019855488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851387.357877:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019855488:12345-0@lo:502:mount.lustre.0 Request processed in 113us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851387.357885:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788851387.357938:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86ae7600 going to sleep for 11 seconds 00000100:00100000:2.0:1788851387.357963:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019855488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851387.358155:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788851387.358177:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788851387.358219:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019855616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851387.358255:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851387.358283:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86ae7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788851387.362592:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019855616 00000100:00100000:0.0:1788851387.362606:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019855616 00000100:00100000:0.0:1788851387.362662:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788851387.362672:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019855616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851387.362850:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019855616:12345-0@lo:502:mount.lustre.0 Request processed in 178us (4593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851387.362858:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788851387.363639:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019855616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788851387.363737:0:24274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788851387.363751:0:24274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788851387.365995:0:24300:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788851387.366038:0:24300:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff892eb6f44d40) 00000020:00000080:1.0:1788851387.366064:0:24300:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788851387.366153:0:24300:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892e983ab800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788851387.366158:0:24300:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892e983ab800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788851387.366161:0:24300:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892e983ab800 3 00010000:00080000:1.0:1788851387.366193:0:24300:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892ea5932000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1788851387.369160:0:24300:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788851387.372392:0:24300:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788851387.372442:0:24300:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788851387.372455:0:24300:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3e0030720b207536 00000100:00080000:1.0:1788851387.372469:0:24300:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788851387.372482:0:24300:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff892ea5932000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851387.372525:0:24300:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e8707b480 x1875746019855744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851387.372559:0:24300:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788851387.374413:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019855744:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788851387.374491:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788851387.374803:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851387.374808:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851387.374811:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851387.374814:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851387.374827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851387.374830:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851387.374833:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851387.374836:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788851387.378097:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019855744 00000100:00100000:3.0:1788851387.378116:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019855744 00000100:00100000:3.0:1788851387.378174:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788851387.378182:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019855744:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788851387.379332:0:22770:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 721 last 0 00000020:00000080:3.0:1788851387.379376:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e0030720b20753d 00000004:00100000:3.0:1788851387.379395:0:22770:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788851387.379427:0:22770:0:(import.c:65:import_set_state_nolock()) ffff892d81a49000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851387.379518:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875746019855744:12345-0@lo:38:llog_process_th.0 Request processed in 1335us (5026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.379527:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788851387.379596:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e8707b480 x1875746019855744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851387.379609:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788851387.379620:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788851387.379629:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788851387.379634:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788851387.379637:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892ea5932000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788851387.379643:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875746019855744:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1788851387.383869:0:24300:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788851387.383889:0:24300:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff892eb6f419c0) 00000020:00000080:1.0:1788851387.383913:0:24300:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788851387.384003:0:24300:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892e983ab800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788851387.384007:0:24300:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892e983ab800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788851387.384043:0:24300:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892e983ab800 3 00010000:00080000:1.0:1788851387.384078:0:24300:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d81a21000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1788851387.389006:0:24300:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788851387.391924:0:24300:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788851387.392339:0:24300:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788851387.392352:0:24300:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x3e0030720b20754b 00000100:00080000:1.0:1788851387.392363:0:24300:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788851387.392374:0:24300:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff892d81a21000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851387.392425:0:24300:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e87079880 x1875746019855872/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851387.392458:0:24300:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788851387.392484:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851387.392489:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851387.392491:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851387.392495:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851387.392499:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851387.392508:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851387.392511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851387.392513:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788851387.392793:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875746019855872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788851387.392862:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788851387.395374:0:24300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788851387.395528:0:24274:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788851387.395557:0:24274:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788851387.395575:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b207521 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207528 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851387.395589:0:24274:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827eb600/0x3e0030720b207521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207528 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788851387.395651:0:24274:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788851387.395654:0:24274:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788851387.395655:0:24274:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851387.395657:0:24274:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851387.395658:0:24274:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851387.395660:0:24274:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851387.395661:0:24274:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851387.395663:0:24274:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851387.395664:0:24274:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788851387.395668:0:24274:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788851387.395670:0:24274:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788851387.395672:0:24274:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788851387.395673:0:24274:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851387.395674:0:24274:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851387.395675:0:24274:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851387.395676:0:24274:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851387.395677:0:24274:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851387.395678:0:24274:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851387.395679:0:24274:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788851387.395705:0:24274:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788851387.395724:0:24274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019856000:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788851387.395811:0:24274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851387.395854:0:24274:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8533a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788851387.401940:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019856000 00000100:00100000:2.0:1788851387.401954:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019856000 00000100:00100000:2.0:1788851387.402007:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788851387.402038:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e89049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019856000:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788851387.402071:0:22761:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788851387.402084:0:22761:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788851387.402379:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019855872 00000100:00100000:3.0:1788851387.402385:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019855872 00000100:00100000:3.0:1788851387.402409:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788851387.402428:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875746019855872:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788851387.402456:0:22769:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 721 last 0 00000020:00000080:3.0:1788851387.402500:0:22769:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x3e0030720b207552 00000004:00100000:3.0:1788851387.402517:0:22769:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788851387.402551:0:22769:0:(import.c:65:import_set_state_nolock()) ffff892e90e56000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851387.402631:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875746019855872:12345-0@lo:38:llog_process_th.0 Request processed in 202us (9767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.402640:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788851387.402705:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff892e87079880 x1875746019855872/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851387.402718:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788851387.402726:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788851387.402733:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788851387.402738:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788851387.402741:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d81a21000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788851387.402747:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875746019855872:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788851387.413447:0:22761:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788851387.413500:0:22761:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788851387.413901:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e89049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:24274:x1875746019856000:12345-0@lo:253:mount.lustre.0 Request processed in 11861us (18084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851387.413914:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788851387.414359:0:24274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:24274:1875746019856000:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788851387.414375:0:24274:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788851387.414379:0:24274:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788851387.414381:0:24274:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788851387.414382:0:24274:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851387.414383:0:24274:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851387.414385:0:24274:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851387.414386:0:24274:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851387.414388:0:24274:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851387.414390:0:24274:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851387.414391:0:24274:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788851387.414409:0:24274:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788851387.415605:0:22785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788851387.415613:0:22785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788851387.415638:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.415659:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebbdab200/0x3e0030720b2074a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20749c expref: 20 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.415666:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebbdab000/0x3e0030720b2074b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2074aa expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.415674:0:22785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.415714:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebbdab000/0x3e0030720b2074b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2074aa expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.415729:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ebbdab000/0x3e0030720b2074b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2074aa expref: 20 pid: 22764 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851387.415743:0:22785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019856128:0@lo:104: 00000100:00100000:0.0:1788851387.415802:0:22785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788851387.415845:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebbdab200/0x3e0030720b2074a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b20749c expref: 20 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851387.415861:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ebbdab200/0x3e0030720b2074a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b20749c expref: 20 pid: 22761 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851387.415871:0:22785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019856256:0@lo:104: 00000100:00100000:0.0:1788851387.415898:0:22785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851387.415961:0:22785:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccda80 going to sleep for 11 seconds 00000001:00000004:1.0:1788851387.417626:0:24274:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788851387.420601:0:24274:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788851387.420612:0:24274:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788851387.420652:0:24274:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788851387.420699:0:24274:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788851387.420723:0:24274:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788851387.420750:0:24274:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788851387.422751:0:24274:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851387.422984:0:24274:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788851387.423372:0:22752:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788851387.423406:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019856128 00000100:00100000:3.0:1788851387.423415:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019856128 00000100:00100000:3.0:1788851387.423452:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019856256 00000100:00100000:3.0:1788851387.423455:0:22752:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019856256 00000100:00100000:3.0:1788851387.423471:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851387.423481:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+4:22785:x1875746019856128:12345-0@lo:104: 00010000:00010000:3.0:1788851387.423499:0:22752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2074b1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.423609:0:22752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788851387.423616:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+4:22785:x1875746019856128:12345-0@lo:104: Request processed in 137us (7814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.423624:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851387.423643:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851387.423649:0:22752:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+3:22785:x1875746019856256:12345-0@lo:104: 00010000:00010000:3.0:1788851387.423657:0:22752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2074a3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.423693:0:22752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788851387.423698:0:22752:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+3:22785:x1875746019856256:12345-0@lo:104: Request processed in 50us (7800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.423705:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788851387.423842:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788851387.423849:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2074b1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.423856:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851387.423860:0:22757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2074b1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.423868:0:22757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2074b1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851387.423875:0:22757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2074b1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851387.423881:0:22757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788851387.423924:0:22757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2074b1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.423931:0:22757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851387.423951:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2074b1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.423958:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebbdab600/0x3e0030720b2074aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2074b1 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.423977:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851387.423980:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2074a3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.423987:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851387.423989:0:22757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2074a3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.423996:0:22757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2074a3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851387.424003:0:22757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2074a3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851387.424008:0:22757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788851387.424059:0:22757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2074a3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.424066:0:22757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851387.424072:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2074a3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.424087:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ea433d600/0x3e0030720b20749c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2074a3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425355:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851387.425360:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851387.425363:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851387.425372:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851387.425400:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019856384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851387.425460:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851387.425504:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851387.425510:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019856512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851387.425532:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851387.425576:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019856384 00000100:00100000:3.0:1788851387.425582:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019856384 00010000:00010000:3.0:1788851387.425612:0:22755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebbdab000/0x3e0030720b2074b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2074aa expref: 21 pid: 22764 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851387.425636:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019856512 00000100:00100000:3.0:1788851387.425639:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019856512 00010000:00010000:3.0:1788851387.425650:0:22755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebbdab200/0x3e0030720b2074a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20749c expref: 22 pid: 22761 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851387.425664:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851387.425671:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:3649:x1875746019856384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851387.425682:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851387.425687:0:22755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebbdab000/0x3e0030720b2074b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2074aa expref: 22 pid: 22764 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425713:0:22755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebbdab000/0x3e0030720b2074b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2074aa expref: 22 pid: 22764 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425732:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851387.425763:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:3649:x1875746019856384:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.425771:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851387.425786:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851387.425792:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:3649:x1875746019856512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851387.425800:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851387.425805:0:22755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebbdab200/0x3e0030720b2074a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20749c expref: 21 pid: 22761 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425816:0:22755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebbdab200/0x3e0030720b2074a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b20749c expref: 21 pid: 22761 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425828:0:22755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425838:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788851387.425853:0:22755:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011485417s 00010000:00010000:3.0:1788851387.425857:0:22755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425864:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425879:0:22755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425885:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425891:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdaae00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851387.425895:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425902:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425911:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.425922:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851387.425945:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:3649:x1875746019856512:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851387.425952:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851387.430005:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019856512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851387.430081:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019856384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851387.430327:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebbdab000/0x3e0030720b2074b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2074aa expref: 20 pid: 22764 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851387.430352:0:22785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019856128:0@lo:104: 00010000:00010000:3.0:1788851387.430370:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebbdab200/0x3e0030720b2074a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b20749c expref: 19 pid: 22761 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851387.430389:0:22785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019856256:0@lo:104: 00010000:00010000:3.0:1788851387.430420:0:22785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.430430:0:22785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.430437:0:22785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851387.430443:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebbdaae00/0x3e0030720b207559 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851387.469762:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788851388.363798:0:24353:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788851388.369598:0:24353:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788851388.469004:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788851388.917402:0:22766:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788851388.917410:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892eb6cf0800 from 13 10000000:01000000:1.0:1788851388.917415:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788851388.917461:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851388.917474:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851388.917489:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851388.917532:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019856640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788851388.917622:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851388.917747:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e91c86f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788851388.918646:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019856640 00000100:00100000:0.0:1788851388.918656:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019856640 00000100:00100000:0.0:1788851388.918710:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788851388.918720:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8904b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+19:22766:x1875746019856640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851388.918737:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851388.918757:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207560 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851388.918786:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207560 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851388.918798:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207560 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851388.918806:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdaa800, rc 0) 00000100:00100000:0.0:1788851388.918884:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8904b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:22766:x1875746019856640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851388.918891:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788851388.919730:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019856640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851388.919761:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207567 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851388.919773:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b207567 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851388.919852:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019856768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788851388.919910:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851388.919951:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e91c86f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851388.920230:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019856768 00000100:00100000:2.0:1788851388.920238:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019856768 00000100:00100000:2.0:1788851388.920289:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788851388.920297:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e89048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:22766:x1875746019856768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788851388.920313:0:22761:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788851388.920330:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788851388.920333:0:22761:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788851388.920427:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e89048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:22766:x1875746019856768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851388.920434:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788851388.920642:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019856768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788851388.920700:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788851388.920707:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207567 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851388.920717:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207567 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851388.920727:0:22766:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788851388.920730:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892d89078800 from 13 10000000:01000000:1.0:1788851388.920733:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788851388.920774:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851388.920791:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851388.920802:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851388.920817:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019856896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788851388.920849:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851388.920870:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e91c86f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851388.920965:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019856896 00000100:00100000:2.0:1788851388.920971:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019856896 00000100:00100000:2.0:1788851388.921007:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788851388.921040:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e89048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:22766:x1875746019856896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851388.921049:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851388.921064:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff94200/0x3e0030720b207575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b20756e expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851388.921084:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff94200/0x3e0030720b207575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b20756e expref: 21 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851388.921092:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff94200/0x3e0030720b207575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20756e expref: 21 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851388.921099:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94200, rc 0) 00000100:00100000:2.0:1788851388.921132:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e89048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:22766:x1875746019856896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851388.921138:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788851388.921334:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019856896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851388.921347:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207575 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851388.921358:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b207575 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851388.921399:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019857024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788851388.921428:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851388.921453:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e91c86f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788851388.921491:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019857024 00000100:00100000:0.0:1788851388.921495:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019857024 00000100:00100000:0.0:1788851388.921518:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788851388.921525:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e89049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:22766:x1875746019857024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788851388.921543:0:22764:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788851388.921554:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788851388.921557:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788851388.921636:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e89049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:22766:x1875746019857024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851388.921644:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788851388.921737:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e87078000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019857024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788851388.921787:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788851388.921793:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207575 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851388.921801:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207575 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851389.492379:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788851390.011000:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788851390.516280:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851391.556617:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851392.436342:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019857152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851392.436417:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851392.436496:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019857152 00000100:00100000:3.0:1788851392.436503:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019857152 00000100:00100000:3.0:1788851392.436548:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788851392.436556:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019857152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851392.436592:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788851392.436637:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019857152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851392.436644:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788851392.436694:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019857152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851392.436939:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019857280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851392.436965:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851392.437197:0:23778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019857280 00000100:00100000:2.0:1788851392.437202:0:23778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019857280 00000100:00100000:2.0:1788851392.437225:0:23778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788851392.437231:0:23778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019857280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851392.437249:0:23778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788851392.437280:0:23778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019857280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851392.437292:0:23778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788851392.437375:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019857280:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788851392.438555:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851392.438561:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851392.438564:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851392.438568:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851392.438584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851392.438587:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851392.438590:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851392.438593:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788851392.438642:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019857536:0@lo:400:kworker.0 00000100:00100000:2.0:1788851392.438693:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851392.438725:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788851392.438731:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3650:1875746019857408:0@lo:400:kworker.0 00000100:00100000:2.0:1788851392.438761:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851392.438800:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019857920:0@lo:400:kworker.0 00000100:00100000:2.0:1788851392.438822:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851392.438856:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019857536 00000100:00100000:2.0:1788851392.438862:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019857536 00000100:00100000:2.0:1788851392.438896:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019857920 00000100:00100000:2.0:1788851392.438898:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019857920 00000100:00100000:3.0:1788851392.440283:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019857792:0@lo:400:kworker.0 00000100:00100000:3.0:1788851392.440355:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851392.440383:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851392.440390:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019857664:0@lo:400:kworker.0 00000100:00100000:3.0:1788851392.440412:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851392.441617:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019857792 00000100:00100000:2.0:1788851392.441627:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019857792 00000100:00100000:2.0:1788851392.441649:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019857664 00000100:00100000:2.0:1788851392.441651:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019857664 00000100:00100000:2.0:1788851392.441677:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788851392.441685:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019857536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851392.441760:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019857536:12345-0@lo:400:kworker.0 Request processed in 75us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851392.441767:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788851392.441782:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788851392.441789:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019857920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851392.441815:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019857920:12345-0@lo:400:kworker.0 Request processed in 27us (2992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851392.441820:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788851392.441830:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851392.441836:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019857792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851392.441882:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019857792:12345-0@lo:400:kworker.0 Request processed in 46us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851392.441889:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851392.441900:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788851392.441906:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019857664:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788851392.442066:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851392.442072:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788851392.442606:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590d500 x1875746019857792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851392.442623:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019857792:0@lo:400:kworker.0 00010000:00080000:1.0:1788851392.442811:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590fb80 x1875746019857920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851392.442823:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019857920:0@lo:400:kworker.0 00010000:00080000:1.0:1788851392.442835:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590d880 x1875746019857536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851392.442845:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019857536:0@lo:400:kworker.0 00000100:00100000:3.0:1788851392.443076:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019857408 00000100:00100000:3.0:1788851392.443084:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019857408 00000100:00100000:3.0:1788851392.443135:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788851392.443144:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8904ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:3650:x1875746019857408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851392.443210:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8904ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:3650:x1875746019857408:12345-0@lo:400:kworker.0 Request processed in 67us (4447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851392.443218:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788851392.443654:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019857664:12345-0@lo:400:kworker.0 Request processed in 1747us (3239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851392.443663:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788851392.444105:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590e680 x1875746019857664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851392.444119:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019857664:0@lo:400:kworker.0 00000100:00100000:1.0:1788851392.444214:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3650:1875746019857408:0@lo:400:kworker.0 00010000:00010000:1.0:1788851392.564510:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788851393.217509:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788851393.588438:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788851394.030446:0:24644:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788851394.628675:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788851394.960994:0:24696:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788851394.961469:0:24696:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788851395.643692:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788851396.021986:0:24746:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788851396.022295:0:24746:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788851396.596743:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851381/real 1788851381] req@ffff892d8839b800 x1875746019850752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851396 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851396.596776:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892d8839b800 x1875746019850752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851396 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851396.596875:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851381/real 1788851381] req@ffff892d88399880 x1875746019850880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851396 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851396.596889:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892d88399880 x1875746019850880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851396 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788851396.596911:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e87c1f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788851396.596940:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788851396.596944:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019850752:0@lo:8:kworker.0 00000100:00080000:0.0:1788851396.596951:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e90e54000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788851396.596956:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788851396.596959:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019850880:0@lo:8:kworker.0 00000100:00100000:3.0:1788851396.597173:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3650:1875746019858048:0@lo:400:kworker.0 00000100:00100000:3.0:1788851396.597246:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851396.597339:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019858048 00000100:00100000:0.0:1788851396.597348:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019858048 00000100:00100000:0.0:1788851396.597402:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788851396.597411:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:3650:x1875746019858048:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788851396.599609:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851396.599617:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851396.599619:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851396.599631:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788851396.599755:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019858432:0@lo:400:kworker.0 00000100:00100000:1.0:1788851396.599850:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851396.601586:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:3650:x1875746019858048:12345-0@lo:400:kworker.0 Request processed in 4167us (4331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851396.601603:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788851396.601713:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851396.601718:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788851396.601722:0:8:0:(import.c:65:import_set_state_nolock()) ffff892e87c1f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851396.601727:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 715 00000100:00080000:2.0:1788851396.601732:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788851396.601740:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff892e87c1f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851396.601769:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea590ca80 x1875746019858560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788851396.601804:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851396.601807:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788851396.601809:0:8:0:(import.c:65:import_set_state_nolock()) ffff892e90e54000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851396.601812:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 715 00000100:00080000:2.0:1788851396.601815:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788851396.601818:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892e90e54000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851396.601828:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea590dc00 x1875746019858688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788851396.601982:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019858560:0@lo:8:kworker.0 00000100:00100000:0.0:1788851396.602073:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851396.602124:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019858688:0@lo:8:kworker.0 00000100:00100000:0.0:1788851396.602149:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851396.602407:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019858560 00000100:00100000:2.0:1788851396.602416:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019858560 00000100:00100000:2.0:1788851396.602446:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019858688 00000100:00100000:2.0:1788851396.602449:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019858688 00000100:00100000:2.0:1788851396.602460:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788851396.602469:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019858560:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788851396.602504:0:24278:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 730 last 0 00000020:00000080:2.0:1788851396.602537:0:24278:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b20757c 00002000:00100000:2.0:1788851396.602562:0:24278:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff892d86bd0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788851396.602566:0:24278:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788851396.602569:0:24278:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788851396.602775:0:24278:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788851396.602826:0:24278:0:(import.c:65:import_set_state_nolock()) ffff892d86bd2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851396.602883:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875746019858560:12345-0@lo:8:kworker.0 Request processed in 414us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851396.602891:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788851396.602907:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851396.602911:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019858688:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788851396.602922:0:24278:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788851396.609636:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851396.609673:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019858816:0@lo:400:kworker.0 00000100:00100000:1.0:1788851396.609765:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851396.609827:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019858816 00000100:00100000:1.0:1788851396.609837:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019858816 00000100:00100000:1.0:1788851396.609900:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788851396.609909:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019858816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851396.609959:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019858816:12345-0@lo:400:kworker.0 Request processed in 52us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851396.609984:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788851396.610048:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590c380 x1875746019858816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851396.610061:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019858816:0@lo:400:kworker.0 00010000:00080000:0.0:1788851396.610937:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590ca80 x1875746019858560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788851416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851396.610949:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788851396.610959:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788851396.610969:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788851396.610975:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788851396.610978:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e87c1f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788851396.611006:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788851396.611034:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019858560:0@lo:8:kworker.0 00000004:00080000:1.0:1788851396.611176:0:23513:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788851396.611197:0:23513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23513:1875746019859328:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788851396.611247:0:23513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851396.611270:0:23513:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81a453c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851396.611288:0:24280:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788851396.611294:0:24280:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788851396.611431:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019859200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788851396.611463:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851396.611504:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019859200 00000100:00100000:0.0:1788851396.611510:0:24282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019859200 00000100:00100000:0.0:1788851396.611550:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851396.611558:0:24282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875746019859200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788851396.611582:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788851396.611637:0:24282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875746019859200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851396.611657:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788851396.611676:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788851396.611695:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e8707aa00 x1875746019859200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851396.611712:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019859200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788851396.611903:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019859328 00000100:00100000:0.0:1788851396.611908:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019859328 00000100:00100000:1.0:1788851396.613007:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788851396.613117:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23513:x1875746019859328:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788851396.613504:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3650:1875746019858048:0@lo:400:kworker.0 00000100:00100000:3.0:1788851396.613551:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019858176:0@lo:400:kworker.0 00000100:00100000:3.0:1788851396.613611:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851396.613643:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019858944:0@lo:400:kworker.0 00000100:00100000:3.0:1788851396.613669:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851396.613694:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788851396.613701:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019858304:0@lo:400:kworker.0 00000100:00100000:3.0:1788851396.613723:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851396.613741:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019859072:0@lo:400:kworker.0 00000100:00100000:3.0:1788851396.613762:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851396.614175:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019858432 00000100:00100000:3.0:1788851396.614182:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019858432 00000100:00100000:3.0:1788851396.614214:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019858176 00000100:00100000:3.0:1788851396.614216:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019858176 00000100:00100000:3.0:1788851396.614228:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788851396.614234:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019858432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851396.614281:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019858432:12345-0@lo:400:kworker.0 Request processed in 47us (14432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851396.614287:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788851396.614301:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788851396.614305:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019858176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851396.614330:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019858176:12345-0@lo:400:kworker.0 Request processed in 24us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851396.614336:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1788851396.614363:0:23512:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788851396.614580:0:23512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 730673566690ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788851396.614588:0:23512:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788851396.614615:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019858944 00000100:00100000:3.0:1788851396.614619:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019858944 00000100:00100000:3.0:1788851396.614645:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019858304 00000100:00100000:3.0:1788851396.614648:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019858304 00000100:00100000:3.0:1788851396.614658:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019859072 00000100:00100000:3.0:1788851396.614661:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019859072 00000100:00100000:3.0:1788851396.614674:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788851396.614680:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019858944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851396.614711:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019858944:12345-0@lo:400:kworker.0 Request processed in 31us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851396.614716:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788851396.614728:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788851396.614733:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019858304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851396.614756:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019858304:12345-0@lo:400:kworker.0 Request processed in 24us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851396.614761:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788851396.614773:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788851396.615789:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019859072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851396.615860:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019859072:12345-0@lo:400:kworker.0 Request processed in 1078us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851396.615868:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788851396.615922:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590ed80 x1875746019858304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851396.615935:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019858304:0@lo:400:kworker.0 00010000:00080000:3.0:1788851396.615959:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590f480 x1875746019859072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851396.615973:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019859072:0@lo:400:kworker.0 00000100:00100000:3.0:1788851396.615985:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019858176:0@lo:400:kworker.0 00010000:00080000:3.0:1788851396.615995:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590d180 x1875746019858944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851396.616002:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019858944:0@lo:400:kworker.0 00000100:00080000:0.0:1788851396.616344:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851396.616349:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851396.616372:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019858432:0@lo:400:kworker.0 00002000:00080000:0.0:1788851396.622754:0:24765:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788851396.622767:0:24765:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788851396.622863:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23513:x1875746019859328:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9749us (11611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851396.622879:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788851396.627653:0:23513:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e8707bb80 x1875746019859328/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788851412 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851396.627674:0:23513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23513:1875746019859328:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788851396.627690:0:23513:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788851396.627734:0:23513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23513:1875746019859456:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788851396.627790:0:23513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851396.627821:0:23513:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81a453c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851396.627930:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019859456 00000100:00100000:1.0:1788851396.627938:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019859456 00000100:00100000:1.0:1788851396.627991:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788851396.628001:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23513:x1875746019859456:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788851396.628055:0:24280:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788851396.628130:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23513:x1875746019859456:12345-0@lo:5:osp-pre-0-1.0 Request processed in 130us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851396.628138:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788851396.628177:0:23513:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e8707bb80 x1875746019859456/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788851412 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851396.628188:0:23513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23513:1875746019859456:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788851396.628197:0:23513:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788851396.628224:0:23513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23513:1875746019859584:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788851396.628245:0:23513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851396.628259:0:23513:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81a453c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851396.630278:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019859584 00000100:00100000:0.0:1788851396.630293:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019859584 00000100:00100000:0.0:1788851396.630351:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851396.630360:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23513:x1875746019859584:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788851396.630410:0:24765:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:1.0:1788851396.630772:0:23503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00010000:3.0:1788851396.660500:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851396.666575:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019858688:12345-0@lo:8:kworker.0 Request processed in 63651us (64413us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788851396.666589:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788851396.666867:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e90e54000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851396.666873:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788851396.666878:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019858688:0@lo:8:kworker.0 00000001:00080000:1.0:1788851396.673861:0:24275:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788851396.673879:0:24275:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788851396.674440:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23513:x1875746019859584:12345-0@lo:5:osp-pre-0-1.0 Request processed in 44076us (46188us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788851396.674456:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788851396.674569:0:23513:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e8707bb80 x1875746019859584/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788851412 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851396.674581:0:23513:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788851396.674588:0:23513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23513:1875746019859584:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788851396.674605:0:23513:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1788851396.674747:0:23513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23513:1875746019859712:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788851396.674787:0:23513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851396.674863:0:23513:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81a453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851396.674904:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019859712 00000100:00100000:2.0:1788851396.674912:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019859712 00000100:00100000:2.0:1788851396.674960:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851396.674969:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23513:x1875746019859712:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788851396.675348:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23513:x1875746019859712:12345-0@lo:900:osp-pre-0-1.0 Request processed in 378us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851396.675355:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788851396.675408:0:23513:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e8707bb80 x1875746019859712/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788851412 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851396.675419:0:23513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23513:1875746019859712:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788851397.556276:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019859840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851397.556347:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851397.556409:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019859840 00000100:00100000:3.0:1788851397.556417:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019859840 00000100:00100000:3.0:1788851397.556614:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788851397.556625:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019859840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851397.556658:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788851397.556703:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019859840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851397.556710:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788851397.556742:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019859968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851397.556779:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851397.556816:0:23778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019859968 00000100:00100000:3.0:1788851397.556820:0:23778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019859968 00000100:00100000:3.0:1788851397.556844:0:23778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788851397.556852:0:23778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019859968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851397.556871:0:23778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788851397.556905:0:23778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019859968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851397.556913:0:23778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788851397.556952:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019859968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851397.556982:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019859840:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788851397.684288:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851398.708398:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851399.735164:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851400.244861:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788851400.756318:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851401.653704:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851401.653727:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019860096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851401.653797:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851401.653863:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019860096 00000100:00100000:1.0:1788851401.653872:0:24282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019860096 00000100:00100000:1.0:1788851401.653942:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788851401.653953:0:24282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019860096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851401.653981:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788851401.654328:0:24282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019860096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 376us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851401.654336:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788851401.654357:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788851401.654386:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e8707bb80 x1875746019860096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851401.654404:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019860096:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788851401.657870:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851401.657877:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851401.657880:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851401.657883:0:23321:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851401.657907:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851401.657918:0:23321:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788851401.657922:0:23321:0:(import.c:65:import_set_state_nolock()) ffff892e90e54000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851401.657942:0:23321:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 730 00000100:00080000:2.0:1788851401.657948:0:23321:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788851401.657961:0:23321:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892e90e54000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1788851401.657983:0:23321:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea590ed80 x1875746019860736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788851401.658199:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019860736:0@lo:8:kworker.0 00000100:00100000:2.0:1788851401.658263:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851401.658318:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019860608:0@lo:400:kworker.0 00000100:00100000:2.0:1788851401.658350:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851401.658371:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788851401.658376:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019860480:0@lo:400:kworker.0 00000100:00100000:2.0:1788851401.658400:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851401.658419:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019861120:0@lo:400:kworker.0 00000100:00100000:2.0:1788851401.658437:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851401.658462:0:23778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019860608 00000100:00100000:2.0:1788851401.658470:0:23778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019860608 00000100:00100000:2.0:1788851401.658516:0:23778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788851401.658525:0:23778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019860608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851401.658579:0:23778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019860608:12345-0@lo:400:kworker.0 Request processed in 55us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851401.658585:0:23778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788851401.658623:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019860480 00000100:00100000:2.0:1788851401.658628:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019860480 00000100:00100000:3.0:1788851401.658788:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019860224:0@lo:400:kworker.0 00000100:00100000:3.0:1788851401.658823:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851401.658845:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019860864:0@lo:400:kworker.0 00000100:00100000:3.0:1788851401.658867:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851401.658933:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019860352:0@lo:400:kworker.0 00000100:00100000:1.0:1788851401.658965:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851401.658984:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019860992:0@lo:400:kworker.0 00000100:00100000:1.0:1788851401.659055:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019860736 00000100:00100000:1.0:1788851401.659059:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019860736 00000100:00100000:1.0:1788851401.659077:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788851401.659082:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875746019860736:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788851401.659101:0:24281:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788851401.659148:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875746019860736:12345-0@lo:8:kworker.0 Request processed in 64us (885us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788851401.659155:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788851401.659175:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019860224 00000100:00100000:1.0:1788851401.659178:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019860224 00000100:00100000:1.0:1788851401.659203:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788851401.659209:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:3649:x1875746019860224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851401.659236:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:3649:x1875746019860224:12345-0@lo:400:kworker.0 Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851401.659242:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788851401.659266:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019860352 00000100:00100000:1.0:1788851401.659270:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019860352 00000100:00100000:1.0:1788851401.659290:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788851401.659295:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019860352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851401.659330:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019860352:12345-0@lo:400:kworker.0 Request processed in 34us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851401.659335:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788851401.659370:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e90e54000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851401.659375:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788851401.659378:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019860736:0@lo:8:kworker.0 00000100:00100000:3.0:1788851401.669962:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019860224:0@lo:400:kworker.0 00000100:00100000:1.0:1788851401.670810:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851401.678905:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019861120 00000100:00100000:2.0:1788851401.679150:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019861120 00000100:00100000:2.0:1788851401.679227:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019860864 00000100:00100000:2.0:1788851401.679231:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019860864 00000100:00100000:2.0:1788851401.679255:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788851401.679264:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019860480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851401.679354:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875746019860480:12345-0@lo:400:kworker.0 Request processed in 91us (20951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851401.679361:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788851401.679381:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788851401.679387:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019861120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851401.679416:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875746019861120:12345-0@lo:400:kworker.0 Request processed in 30us (20978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851401.679422:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788851401.679434:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788851401.679440:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019860864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851401.679484:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019860864:12345-0@lo:400:kworker.0 Request processed in 45us (20616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851401.679490:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788851401.679545:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590e300 x1875746019860480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851401.679562:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875746019860480:0@lo:400:kworker.0 00010000:00080000:2.0:1788851401.679575:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590c380 x1875746019861120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851401.679583:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875746019861120:0@lo:400:kworker.0 00000100:00100000:2.0:1788851401.679595:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019860608:0@lo:400:kworker.0 00010000:00080000:2.0:1788851401.682712:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590f100 x1875746019860864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851401.682732:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019860864:0@lo:400:kworker.0 00000100:00080000:0.0:1788851401.682894:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851401.686340:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019860352:0@lo:400:kworker.0 00000100:00100000:3.0:1788851401.686476:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019860992 00000100:00100000:3.0:1788851401.686874:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019860992 00000100:00100000:3.0:1788851401.687054:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788851401.687064:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019860992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851401.687143:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019860992:12345-0@lo:400:kworker.0 Request processed in 80us (16334us total) trans 0 rc 0/0 00000100:00080000:1.0:1788851401.687220:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788851401.687250:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea590ca80 x1875746019860992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851401.687263:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019860992:0@lo:400:kworker.0 00000100:00100000:3.0:1788851401.690213:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788851401.780268:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788851402.501602:0:25092:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788851402.501606:0:25092:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788851402.501613:0:25092:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788851402.501730:0:25092:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff892d881cb800 00000020:01000004:0.0:1788851402.501746:0:25092:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788851402.501761:0:25092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788851402.501775:0:25092:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff892eaca099c0) 00000020:00000080:0.0:1788851402.501792:0:25092:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788851402.543514:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788851402.544416:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788851402.544758:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788851402.545149:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788851402.545387:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788851402.545646:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788851402.546007:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788851402.549580:0:25092:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788851402.550166:0:25092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788851402.550182:0:25092:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788851402.550195:0:25092:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3e0030720b20758a 00000020:01000004:3.0:1788851402.550204:0:25092:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788851402.550226:0:25092:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788851402.550230:0:25092:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788851402.550236:0:25092:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788851402.550267:0:25092:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788851402.550272:0:25092:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788851402.575305:0:25092:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788851402.575353:0:25092:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788851402.575358:0:25092:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788851402.575360:0:25092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788851402.575361:0:25092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851402.575363:0:25092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851402.575364:0:25092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851402.575366:0:25092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851402.575367:0:25092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851402.575369:0:25092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851402.575370:0:25092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788851402.575375:0:25092:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788851402.575377:0:25092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788851402.575379:0:25092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788851402.575380:0:25092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851402.575381:0:25092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851402.575383:0:25092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851402.575384:0:25092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851402.575385:0:25092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851402.575386:0:25092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851402.575387:0:25092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788851402.575425:0:25092:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788851402.575447:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019861248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788851402.575523:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851402.575571:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb67c9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788851402.575860:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019861248 00000100:00100000:3.0:1788851402.575869:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019861248 00000100:00100000:3.0:1788851402.575938:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788851402.575947:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:25092:x1875746019861248:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788851402.575996:0:22761:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788851402.575999:0:22761:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788851402.576003:0:22761:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788851402.576455:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:25092:x1875746019861248:12345-0@lo:253:mount.lustre.0 Request processed in 508us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851402.576464:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788851402.576889:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019861248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788851402.576901:0:25092:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788851402.576904:0:25092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788851402.576905:0:25092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788851402.576989:0:25092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851402.576990:0:25092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851402.576991:0:25092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851402.576992:0:25092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851402.576994:0:25092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851402.576995:0:25092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851402.576996:0:25092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788851402.577872:0:25092:0:(tgt_mount.c:101:server_register_mount()) register mount ffff892d881cb800 from lustre-OST0001 10000000:01000000:2.0:1788851402.577927:0:25092:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788851402.577931:0:25092:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788851402.577942:0:25092:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff892ead6d8000 local copy 00010000:00010000:2.0:1788851402.577953:0:25092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851402.578132:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019861376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851402.578187:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851402.578284:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb67c9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788851402.578972:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019861376 00000100:00100000:1.0:1788851402.578990:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019861376 00000100:00100000:2.0:1788851402.581407:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788851402.581429:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:25092:x1875746019861376:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851402.581594:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:25092:x1875746019861376:12345-0@lo:501:mount.lustre.0 Request processed in 175us (3405us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788851402.581603:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788851402.581722:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019861376:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788851402.581748:0:25092:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788851402.581787:0:25092:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788851402.581797:0:25092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.581807:0:25092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebff94600/0x3e0030720b2072a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2072ab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851402.581841:0:25092:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff892d881cb800 10000000:01000000:1.0:1788851402.581846:0:25092:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788851402.581853:0:25092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788851402.581856:0:25092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788851402.581860:0:25092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788851402.581863:0:25092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788851402.581895:0:25092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb000/0x3e0030720b207591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.581904:0:25092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e827eb000/0x3e0030720b207591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.581922:0:25092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e827eb000/0x3e0030720b207591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851402.581941:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019861504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851402.581988:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.582060:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84bfa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851402.582189:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019861504 00000100:00100000:2.0:1788851402.582195:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019861504 00000100:00100000:2.0:1788851402.582230:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788851402.582238:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:25092:x1875746019861504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851402.582247:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851402.582259:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff94e00/0x3e0030720b207598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207591 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.582280:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff94e00/0x3e0030720b207598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207591 expref: 22 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.582298:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff94e00/0x3e0030720b207598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207591 expref: 22 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.582307:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94e00, rc 0) 00000100:00100000:2.0:1788851402.582338:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:25092:x1875746019861504:12345-0@lo:101:mount.lustre.0 Request processed in 101us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851402.582344:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788851402.582610:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019861504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851402.582623:0:25092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e827eb000/0x3e0030720b207591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207598 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.582632:0:25092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e827eb000/0x3e0030720b207591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b207598 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851402.584194:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1788851402.585220:0:25092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851402.588399:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788851402.588466:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788851402.588484:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788851402.588499:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788851402.588514:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788851402.588528:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788851402.588543:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788851402.588558:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788851402.588574:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788851402.588604:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788851402.588611:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788851402.589833:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019861632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851402.589989:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851402.590159:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851402.590253:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019861632 00000100:00100000:2.0:1788851402.590262:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019861632 00000100:00100000:2.0:1788851402.590343:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788851402.590353:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:25092:x1875746019861632:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851402.590537:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:25092:x1875746019861632:12345-0@lo:501:mount.lustre.0 Request processed in 185us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851402.590545:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788851402.590625:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019861632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851402.590663:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019861760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788851402.590736:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851402.591946:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851402.592143:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019861760 00000100:00100000:1.0:1788851402.592152:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019861760 00000100:00100000:1.0:1788851402.592209:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788851402.592219:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:25092:x1875746019861760:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851402.593481:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:25092:x1875746019861760:12345-0@lo:503:mount.lustre.0 Request processed in 1259us (2739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.593492:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788851402.593614:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019861760:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788851402.594156:0:25092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788851402.594251:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019861888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851402.594301:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851402.594346:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e81377f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788851402.594597:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019861888 00000100:00100000:1.0:1788851402.594604:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019861888 00000100:00100000:1.0:1788851402.594638:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788851402.594646:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:25092:x1875746019861888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851402.595350:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:25092:x1875746019861888:12345-0@lo:502:mount.lustre.0 Request processed in 699us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.595361:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788851402.595483:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019861888:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788851402.595896:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788851402.595937:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788851402.595952:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788851402.595964:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788851402.595986:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788851402.596000:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788851402.596046:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788851402.596062:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788851402.596076:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1788851402.596110:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851402.596162:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851402.596187:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e860cf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851402.597279:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019862016 00000100:00100000:2.0:1788851402.597293:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019862016 00000100:00100000:2.0:1788851402.597362:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788851402.597373:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:25092:x1875746019862016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851402.597527:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:25092:x1875746019862016:12345-0@lo:502:mount.lustre.0 Request processed in 155us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851402.597537:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788851402.597594:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788851402.597666:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1788851402.597678:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788851402.599536:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788851402.599547:0:25096:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788851402.599554:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851402.599556:0:25096:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788851402.599563:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788851402.599592:0:25096:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff892d868719c0) 00000020:00000080:0.0:1788851402.599620:0:25096:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788851402.599627:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788851402.599733:0:25096:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892d881cb800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788851402.599742:0:25096:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788851402.599749:0:25096:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3e0030720b2075a6 00010000:00010000:0.0:1788851402.605306:0:25096:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788851402.606410:0:25096:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1788851402.611921:0:25096:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788851402.616754:0:25096:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788851402.616769:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851402.616776:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.616778:0:25096:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788851402.616782:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851402.616792:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.616793:0:25096:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788851402.616798:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788851402.616800:0:25096:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788851402.616803:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851402.616805:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.616806:0:25096:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788851402.616809:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851402.616811:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.616812:0:25096:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788851402.616816:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788851402.616845:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851402.616848:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.616850:0:25096:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788851402.616853:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1788851402.617094:0:25092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788851402.617132:0:25092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788851402.617159:0:25092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e827eb000/0x3e0030720b207591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207598 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.617172:0:25092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e827eb000/0x3e0030720b207591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b207598 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851402.617181:0:25092:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892d881cb800 from 1 10000000:01000000:0.0:1788851402.617184:0:25092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851402.617239:0:25092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.617248:0:25092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.617261:0:25092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851402.617290:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788851402.617366:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851402.617400:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851402.619091:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019862144 00000100:00100000:2.0:1788851402.619106:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019862144 00000100:00100000:2.0:1788851402.619156:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788851402.619166:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:25092:x1875746019862144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851402.619182:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851402.619200:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff94a00/0x3e0030720b2075b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2075ad expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.619228:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff94a00/0x3e0030720b2075b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2075ad expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.619239:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff94a00/0x3e0030720b2075b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2075ad expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.619249:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff94a00, rc 0) 00000100:00100000:2.0:1788851402.619316:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:25092:x1875746019862144:12345-0@lo:101:mount.lustre.0 Request processed in 152us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851402.619334:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788851402.620430:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862144:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851402.620454:0:25092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2075b4 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.620465:0:25092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2075b4 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851402.621778:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788851402.622097:0:25092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851402.622383:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788851402.622425:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788851402.622442:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788851402.622454:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788851402.622464:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788851402.622474:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788851402.622486:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788851402.622497:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788851402.622507:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788851402.622518:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788851402.622527:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788851402.622543:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788851402.622548:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788851402.622696:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851402.622757:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851402.622797:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851402.626165:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019862272 00000100:00100000:3.0:1788851402.626196:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019862272 00000100:00100000:3.0:1788851402.626257:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788851402.626268:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:25092:x1875746019862272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851402.626454:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:25092:x1875746019862272:12345-0@lo:501:mount.lustre.0 Request processed in 187us (3695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851402.626462:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788851402.626697:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851402.626752:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862400:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788851402.626803:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851402.626842:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788851402.627169:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019862400 00000100:00100000:2.0:1788851402.627175:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019862400 00000100:00100000:2.0:1788851402.627206:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788851402.627214:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:25092:x1875746019862400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851402.627315:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:25092:x1875746019862400:12345-0@lo:503:mount.lustre.0 Request processed in 102us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851402.627323:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788851402.627329:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862400:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788851402.627838:0:25092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788851402.628448:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862528:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851402.628511:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851402.628537:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019862528 00000100:00100000:0.0:1788851402.628542:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e90e2bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851402.628543:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019862528 00000100:00100000:2.0:1788851402.628584:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788851402.628592:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:25092:x1875746019862528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851402.628687:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:25092:x1875746019862528:12345-0@lo:502:mount.lustre.0 Request processed in 95us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851402.628694:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788851402.628739:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851402.628940:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788851402.628967:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788851402.628997:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788851402.629081:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788851402.629098:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788851402.629111:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788851402.629124:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788851402.629137:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788851402.629150:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788851402.629162:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788851402.629176:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788851402.629217:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851402.629255:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851402.629281:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead29fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851402.630370:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019862656 00000100:00100000:3.0:1788851402.630381:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019862656 00000100:00100000:3.0:1788851402.630431:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788851402.630439:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:25092:x1875746019862656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851402.630583:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:25092:x1875746019862656:12345-0@lo:502:mount.lustre.0 Request processed in 143us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851402.630591:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788851402.632733:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851402.632843:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788851402.632858:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788851402.637350:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851402.637365:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.637368:0:25100:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788851402.637375:0:25100:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892d881cb800 00000020:00000080:2.0:1788851402.637378:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851402.637388:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851402.637391:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.637392:0:25100:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788851402.637395:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851402.637397:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.637399:0:25100:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788851402.637402:0:25100:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff892d881cb800 00000020:00000080:2.0:1788851402.637404:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851402.637458:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851402.637461:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.637463:0:25100:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788851402.637465:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851402.637468:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.637469:0:25100:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788851402.637473:0:25100:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892d881cb800 00000020:00000080:2.0:1788851402.637475:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851402.637492:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851402.637494:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.637496:0:25100:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788851402.637498:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851402.637516:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.637518:0:25100:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788851402.637522:0:25100:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff892d881cb800 00000020:00000080:2.0:1788851402.637524:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851402.637564:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851402.637568:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851402.637569:0:25100:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788851402.637573:0:25100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788851402.645687:0:25092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788851402.645747:0:25092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788851402.645771:0:25092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2075b4 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.645785:0:25092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2075b4 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851402.645858:0:25092:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788851402.645862:0:25092:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff892d881cb800 10000000:01000000:3.0:1788851402.645865:0:25092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff892d881cb800 10000000:01000000:3.0:1788851402.645869:0:25092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788851402.645876:0:25092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff892d881cb800 from 1 10000000:01000000:3.0:1788851402.645879:0:25092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788851402.645937:0:25092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b2075bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.645956:0:25092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b2075bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.645970:0:25092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b2075bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851402.646007:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788851402.646108:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851402.646152:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019862784 00000100:00100000:3.0:1788851402.646161:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019862784 00000100:00100000:3.0:1788851402.646217:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788851402.646226:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:25092:x1875746019862784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851402.646240:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851402.646255:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ea433d600/0x3e0030720b2075c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2075bb expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.646282:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ea433d600/0x3e0030720b2075c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2075bb expref: 24 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.646292:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ea433d600/0x3e0030720b2075c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2075bb expref: 24 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.646300:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ea433d600, rc 0) 00000100:00100000:3.0:1788851402.646332:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019862784:12345-0@lo:101:mount.lustre.0 Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851402.646338:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788851402.646380:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea7556300 going to sleep for 11 seconds 00000100:00100000:3.0:1788851402.646407:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851402.646422:0:25092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b2075bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2075c2 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.646432:0:25092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b2075bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2075c2 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851402.650039:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788851402.650356:0:25092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788851402.651258:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788851402.651298:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788851402.651315:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788851402.651331:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788851402.651345:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788851402.651357:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788851402.651369:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788851402.651382:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788851402.651394:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788851402.651406:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788851402.651441:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788851402.651453:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788851402.651463:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788851402.651477:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788851402.651490:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788851402.651502:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788851402.651515:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788851402.652188:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788851402.652294:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788851402.652310:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788851402.652325:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788851402.652337:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788851402.652352:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788851402.652381:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788851402.652395:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788851402.652409:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788851402.652438:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788851402.652454:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788851402.652466:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788851402.652479:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788851402.656336:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788851402.656391:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788851402.656408:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788851402.656422:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788851402.656436:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788851402.656448:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788851402.656459:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788851402.656472:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788851402.656485:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788851402.656499:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788851402.656511:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788851402.656524:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788851402.657048:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788851402.657065:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788851402.657080:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788851402.657091:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788851402.657105:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788851402.657118:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788851402.659122:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788851402.659181:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788851402.661113:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788851402.661134:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788851402.661246:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851402.661330:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851402.661388:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8679c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788851402.662065:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019862912 00000100:00100000:2.0:1788851402.662073:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019862912 00000100:00100000:2.0:1788851402.662122:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788851402.662131:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89069c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019862912:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851402.662292:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89069c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019862912:12345-0@lo:501:mount.lustre.0 Request processed in 161us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851402.662312:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788851402.663383:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019862912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851402.663435:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019863040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851402.663521:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851402.663560:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8679c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788851402.664625:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019863040 00000100:00100000:1.0:1788851402.664636:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019863040 00000100:00100000:1.0:1788851402.664684:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788851402.664703:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89068c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019863040:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851402.664865:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89068c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019863040:12345-0@lo:503:mount.lustre.0 Request processed in 164us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.664873:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788851402.665042:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019863040:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788851402.665719:0:25092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788851402.665808:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019863168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851402.665866:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851402.667518:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019863168 00000100:00100000:3.0:1788851402.667533:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019863168 00000100:00100000:3.0:1788851402.667582:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788851402.667591:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019863168:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851402.667747:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019863168:12345-0@lo:502:mount.lustre.0 Request processed in 157us (1880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851402.667756:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788851402.672352:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead7399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851402.672401:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019863168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851402.672676:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788851402.672707:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788851402.672719:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788851402.672733:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788851402.672763:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788851402.672777:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788851402.672789:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788851402.672801:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788851402.672814:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788851402.672838:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788851402.672852:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788851402.672865:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788851402.672876:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788851402.672887:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788851402.672899:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788851402.673079:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788851402.673097:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788851402.673110:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788851402.673123:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788851402.673134:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788851402.673159:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788851402.673172:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788851402.673184:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788851402.673780:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788851402.673803:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788851402.673814:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788851402.673826:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788851402.673837:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788851402.673849:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788851402.673863:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788851402.673876:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788851402.673889:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788851402.673902:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788851402.674713:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788851402.674737:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788851402.674752:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788851402.674780:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788851402.674795:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788851402.674808:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788851402.674823:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788851402.674835:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788851402.674849:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788851402.674873:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788851402.674887:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788851402.674899:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788851402.675053:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788851402.675070:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788851402.675083:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788851402.675145:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019863296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851402.675398:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851402.675445:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead7399c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851402.675803:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019863296 00000100:00100000:1.0:1788851402.675812:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019863296 00000100:00100000:1.0:1788851402.675867:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788851402.675876:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019863296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788851402.676442:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019863296:12345-0@lo:502:mount.lustre.0 Request processed in 565us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.676451:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788851402.676501:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851382/real 1788851382] req@ffff892ea7764700 x1875746019852160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851402 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851402.676520:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea7764700 x1875746019852160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851402 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851402.676530:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851382/real 1788851382] req@ffff892ea7767800 x1875746019852288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851402 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851402.676542:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff892ea7767800 x1875746019852288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851402 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788851402.676556:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c57800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851402.676570:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788851402.676573:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019852160:0@lo:8:kworker.0 00000100:00080000:1.0:1788851402.676578:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eb6998800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851402.676583:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788851402.676592:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019852288:0@lo:8:kworker.0 00000100:00080000:1.0:1788851402.676657:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851402.676661:0:23321:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788851402.676664:0:23321:0:(import.c:65:import_set_state_nolock()) ffff892d85c57800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851402.676668:0:23321:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 716 00000100:00080000:1.0:1788851402.676672:0:23321:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788851402.676681:0:23321:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff892d85c57800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851402.676700:0:23321:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e8707b100 x1875746019863552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851402.676711:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851402.677169:0:23321:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788851402.677172:0:23321:0:(import.c:65:import_set_state_nolock()) ffff892eb6998800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851402.677177:0:23321:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 716 00000100:00080000:1.0:1788851402.677180:0:23321:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788851402.677185:0:23321:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff892eb6998800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851402.677201:0:23321:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892e8707a680 x1875746019863680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851402.677241:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851402.677244:0:23321:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788851402.677246:0:23321:0:(import.c:65:import_set_state_nolock()) ffff892e90e54000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851402.677250:0:23321:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 735 00000100:00080000:1.0:1788851402.677252:0:23321:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788851402.677257:0:23321:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892e90e54000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851402.677268:0:23321:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892eb694f480 x1875746019864192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788851402.677316:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019863424:0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.677360:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.677384:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019864320:0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.677409:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.677429:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851402.677434:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019864064:0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.677455:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.677485:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019863808:0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.677506:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.677524:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019864448:0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.677544:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.677562:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788851402.677567:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea7764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019863936:0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.677587:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.677602:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019864576:0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.677619:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.677642:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019863424 00000100:00100000:1.0:1788851402.677649:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019863424 00000100:00100000:1.0:1788851402.677680:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019863936 00000100:00100000:1.0:1788851402.677683:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019863936 00000100:00100000:1.0:1788851402.677697:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788851402.677704:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019863424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851402.678297:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019863296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851402.678509:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788851402.678555:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788851402.678581:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019864832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851402.678753:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851402.678783:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019864832 00000100:00100000:3.0:1788851402.678787:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019864832 00000100:00100000:3.0:1788851402.678829:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788851402.678836:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019864832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851402.679037:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89068850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019864832:12345-0@lo:502:mount.lustre.0 Request processed in 200us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851402.679044:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788851402.679093:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea7556300 going to sleep for 11 seconds 00000100:00100000:3.0:1788851402.679107:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019864832:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851402.679146:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788851402.679154:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:1.0:1788851402.680673:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019863424:12345-0@lo:400:kworker.0 Request processed in 2964us (3307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.680686:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:01000004:3.0:1788851402.681310:0:25105:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788851402.681328:0:25105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff892d87ac4d40) 00000020:00000080:3.0:1788851402.681366:0:25105:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000100:00100000:1.0:1788851402.681431:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000020:01000004:3.0:1788851402.681442:0:25105:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892d881cb800 from lustre-OST0001, refs=3 00000100:00100000:1.0:1788851402.681443:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019863936:12345-0@lo:400:kworker.0 00000020:01000004:3.0:1788851402.681447:0:25105:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892d881cb800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788851402.681450:0:25105:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892d881cb800 3 00010000:00080000:3.0:1788851402.681478:0:25105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892e90002800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.127@tcp at head 00000100:00100000:1.0:1788851402.681501:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019863936:12345-0@lo:400:kworker.0 Request processed in 63us (3914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.681508:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788851402.681535:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019864320 00000100:00100000:1.0:1788851402.681542:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019864320 00000100:00100000:1.0:1788851402.681567:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019863808 00000100:00100000:1.0:1788851402.681570:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019863808 00000100:00100000:1.0:1788851402.681580:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019864448 00000100:00100000:1.0:1788851402.681582:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019864448 00000100:00100000:1.0:1788851402.681593:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019864576 00000100:00100000:1.0:1788851402.681596:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019864576 00000100:00100000:1.0:1788851402.681608:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788851402.681614:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019864320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.681644:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019864320:12345-0@lo:400:kworker.0 Request processed in 30us (4235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.681650:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788851402.681661:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788851402.681667:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019863808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.681691:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019863808:12345-0@lo:400:kworker.0 Request processed in 24us (4183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.681696:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788851402.681706:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788851402.681711:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019864448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.682252:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019864448:12345-0@lo:400:kworker.0 Request processed in 540us (4705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.682269:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788851402.682283:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788851402.682289:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019864576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.682319:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019864576:12345-0@lo:400:kworker.0 Request processed in 31us (4699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.682324:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788851402.682343:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019864064 00000100:00100000:1.0:1788851402.682348:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019864064 00000100:00100000:1.0:1788851402.682376:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788851402.682383:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019864064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.682411:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019864064:12345-0@lo:400:kworker.0 Request processed in 29us (4954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.682416:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788851402.682457:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019864704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851402.682495:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.682535:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851402.682542:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019864960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851402.682577:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.682604:0:23778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019864704 00000100:00100000:1.0:1788851402.682608:0:23778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019864704 00000100:00100000:1.0:1788851402.682628:0:23778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019864960 00000100:00100000:1.0:1788851402.682631:0:23778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019864960 00000100:00100000:1.0:1788851402.682644:0:23778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788851402.682650:0:23778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019864704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788851402.682673:0:23778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788851402.682695:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788851402.682704:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019864960:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851402.682708:0:23778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019864704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (214us total) trans 0 rc 0/0 00000004:00000024:2.0:1788851402.682722:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788851402.682733:0:23778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788851402.682751:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019864960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851402.682756:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788851402.682778:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019864960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851402.682793:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019864704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851402.682820:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019863552:0@lo:8:kworker.0 00000100:00100000:1.0:1788851402.682850:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.682883:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019863680:0@lo:8:kworker.0 00000100:00100000:1.0:1788851402.682906:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.682936:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019864192:0@lo:8:kworker.0 00000100:00100000:1.0:1788851402.682957:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.682996:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019863552 00000100:00100000:1.0:1788851402.683003:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019863552 00000100:00100000:1.0:1788851402.683047:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019863680 00000100:00100000:1.0:1788851402.683050:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019863680 00000100:00100000:1.0:1788851402.683058:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019864192 00000100:00100000:1.0:1788851402.683060:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019864192 00000100:00100000:1.0:1788851402.683070:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788851402.683075:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019863552:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788851402.683106:0:24278:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 736 last 0 00000020:00000080:1.0:1788851402.683133:0:24278:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b2075d0 00002000:00100000:1.0:1788851402.683147:0:24278:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff892d85ce1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788851402.683151:0:24278:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788851402.683154:0:24278:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788851402.683230:0:24278:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788851402.683252:0:24278:0:(import.c:65:import_set_state_nolock()) ffff892d85ce2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851402.683290:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875746019863552:12345-0@lo:8:kworker.0 Request processed in 213us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851402.683292:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788851402.683297:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875746019863680:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788851402.683301:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788851402.683312:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851402.683316:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019864192:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788851402.683332:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875746019863680:12345-0@lo:8:kworker.0 Request processed in 33us (425us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788851402.683338:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788851402.684839:0:25105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788851402.685141:0:25105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788851402.685393:0:25105:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788851402.685418:0:25105:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3e0030720b2075d7 00000100:00080000:3.0:1788851402.685429:0:25105:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788851402.685440:0:25105:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff892e90002800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851402.685479:0:25105:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d8839a680 x1875746019865088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851402.685494:0:25105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788851402.686131:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019863936:0@lo:400:kworker.0 00010000:00080000:2.0:1788851402.686147:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892eb694f800 x1875746019864576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851402.686165:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019864576:0@lo:400:kworker.0 00010000:00080000:2.0:1788851402.686180:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892ea7767800 x1875746019863808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851402.686187:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea7767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019863808:0@lo:400:kworker.0 00010000:00080000:2.0:1788851402.686284:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892eb694c380 x1875746019864448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851402.686294:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019864448:0@lo:400:kworker.0 00010000:00080000:2.0:1788851402.686391:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892eb694d180 x1875746019864064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851402.686399:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019864064:0@lo:400:kworker.0 00000100:00100000:2.0:1788851402.686411:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019863424:0@lo:400:kworker.0 00010000:00080000:2.0:1788851402.686421:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892eb694e680 x1875746019864320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851402.686428:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019864320:0@lo:400:kworker.0 00000100:00100000:1.0:1788851402.688183:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875746019864192:12345-0@lo:8:kworker.0 Request processed in 4392us (4752us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788851402.688201:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851402.688280:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019865088:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788851402.688365:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788851402.688421:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e8707b100 x1875746019863552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788851427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851402.688434:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788851402.688446:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788851402.688456:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788851402.688462:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788851402.688466:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d85c57800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788851402.688481:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788851402.688488:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019863552:0@lo:8:kworker.0 00000100:00100000:1.0:1788851402.688501:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788851402.688504:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eb6998800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851402.688508:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788851402.688511:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019863680:0@lo:8:kworker.0 00000100:00100000:1.0:1788851402.688520:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788851402.688522:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e90e54000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851402.688526:0:3646:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788851402.688529:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019864192:0@lo:8:kworker.0 00000100:00100000:1.0:1788851402.688573:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019865088 00000100:00100000:1.0:1788851402.688579:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019865088 00000100:00100000:1.0:1788851402.688608:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788851402.688614:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875746019865088:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788851402.688638:0:22771:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 736 last 0 00000020:00000080:1.0:1788851402.688673:0:22771:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3e0030720b2075de 00000004:00100000:1.0:1788851402.688687:0:22771:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788851402.688729:0:22771:0:(import.c:65:import_set_state_nolock()) ffff892d85ce2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851402.688776:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875746019865088:12345-0@lo:38:llog_process_th.0 Request processed in 161us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.688783:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:1.0:1788851402.688857:0:22795:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788851402.688876:0:22795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22795:1875746019865344:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788851402.688901:0:22795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.688919:0:22795:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81e13d80 going to sleep for 11 seconds 00000004:00080000:1.0:1788851402.688934:0:22794:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788851402.689121:0:22794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736748107098ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788851402.689128:0:22794:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000004:3.0:1788851402.691337:0:25105:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788851402.691360:0:25105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff892d87ac0000) 00000020:00000080:3.0:1788851402.691386:0:25105:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788851402.691486:0:25105:0:(tgt_mount.c:153:server_get_mount()) get mount ffff892d881cb800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788851402.691491:0:25105:0:(tgt_mount.c:187:server_put_mount()) put mount ffff892d881cb800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788851402.691493:0:25105:0:(obd_mount.c:710:lustre_put_lsi()) put ffff892d881cb800 3 00010000:00080000:3.0:1788851402.691539:0:25105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff892d8745f800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1788851402.693191:0:25105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788851402.693417:0:25105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788851402.693463:0:25105:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788851402.693480:0:25105:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x3e0030720b2075ec 00000100:00080000:3.0:1788851402.693492:0:25105:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788851402.693509:0:25105:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff892d8745f800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851402.693552:0:25105:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892d88398700 x1875746019865472/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851402.693584:0:25105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788851402.695166:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851402.695192:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019865216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851402.695529:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.695591:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019865216 00000100:00100000:1.0:1788851402.695602:0:24282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019865216 00000100:00100000:1.0:1788851402.695658:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788851402.695668:0:24282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019865216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851402.695695:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788851402.696824:0:24282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019865216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1138us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.696836:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788851402.696876:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788851402.696925:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892e85694e00 x1875746019865216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851402.696949:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019865216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851402.697112:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019865344 00000100:00100000:1.0:1788851402.697118:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019865344 00000100:00100000:1.0:1788851402.697160:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788851402.697168:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22795:x1875746019865344:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788851402.697436:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875746019865472:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788851402.698433:0:25105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1788851402.698490:0:25092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788851402.699302:0:25092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788851402.699324:0:25092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b2075bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2075c2 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.699338:0:25092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ea433c200/0x3e0030720b2075bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2075c2 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788851402.699395:0:25092:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788851402.699398:0:25092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788851402.699399:0:25092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851402.699401:0:25092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851402.699402:0:25092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851402.699404:0:25092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851402.699405:0:25092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788851402.699408:0:25092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851402.699409:0:25092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788851402.699414:0:25092:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788851402.699416:0:25092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788851402.699417:0:25092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788851402.699418:0:25092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851402.699419:0:25092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851402.699420:0:25092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851402.699421:0:25092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851402.699422:0:25092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788851402.699423:0:25092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851402.699424:0:25092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788851402.699451:0:25092:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788851402.699473:0:25092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019865600:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788851402.700320:0:25092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851402.700368:0:25092:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea7556c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851402.702072:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019865600 00000100:00100000:2.0:1788851402.702082:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019865600 00000100:00100000:2.0:1788851402.702136:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788851402.702146:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019865600:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788851402.702177:0:22764:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000004:00080000:1.0:1788851402.702275:0:22749:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788851402.702357:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.702390:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019865472 00000100:00100000:1.0:1788851402.702411:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019865472 00000100:00100000:1.0:1788851402.702436:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788851402.702441:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875746019865472:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788851402.702465:0:22770:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 736 last 0 00000020:00000080:1.0:1788851402.702499:0:22770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x3e0030720b2075f3 00000004:00100000:1.0:1788851402.702515:0:22770:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788851402.702546:0:22770:0:(import.c:65:import_set_state_nolock()) ffff892d85ce3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851402.702590:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875746019865472:12345-0@lo:38:llog_process_th.0 Request processed in 147us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.702597:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788851402.702799:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892d88398700 x1875746019865472/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851402.702816:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788851402.702824:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788851402.702832:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788851402.702837:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788851402.702840:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892d8745f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788851402.702847:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875746019865472:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788851402.702865:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff892d8839a680 x1875746019865088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851402.702874:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788851402.702878:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788851402.702882:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788851402.702885:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788851402.702886:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e90002800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788851402.702909:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875746019865088:0@lo:38:llog_process_th.0 00002000:00080000:1.0:1788851402.702933:0:24280:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788851402.702940:0:24280:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1788851402.702944:0:24280:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 20000000:01000000:2.0:1788851402.703296:0:22764:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00002000:00010000:1.0:1788851402.713569:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851402.713581:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2157e7b/0x3e0030720b2075fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.713598:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1788851402.713603:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851402.713680:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2157e7b/0x3e0030720b2075fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.713709:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2157e7b/0x3e0030720b2075fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.713720:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2157e7b/0x3e0030720b2075fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.713728:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2157e7b/0x3e0030720b2075fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.713748:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.713759:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.713765:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2157e7b/0x3e0030720b2075fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.713773:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.713778:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2157e7b/0x3e0030720b2075fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.713787:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2157e7b/0x3e0030720b2075fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.713801:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2157e7b/0x3e0030720b2075fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.713808:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2157e7b/0x3e0030720b2075fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.713836:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.713838:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.713839:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851402.717383:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851402.717398:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207601 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.717415:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1788851402.717420:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851402.717427:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207601 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.717440:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207601 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.717451:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207601 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.717458:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207601 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.717485:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.717506:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.717512:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207601 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.717546:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.717550:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207601 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.717560:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207601 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.717579:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207601 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.717586:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207601 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.717606:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.717730:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.717733:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851402.719466:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851402.719479:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039ba5b20/0x3e0030720b207608 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.719494:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1788851402.719498:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851402.719503:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039ba5b20/0x3e0030720b207608 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.719516:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039ba5b20/0x3e0030720b207608 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.719552:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039ba5b20/0x3e0030720b207608 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.719558:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039ba5b20/0x3e0030720b207608 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.719576:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.719586:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.719591:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039ba5b20/0x3e0030720b207608 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.719599:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.719603:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039ba5b20/0x3e0030720b207608 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.719622:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039ba5b20/0x3e0030720b207608 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.719638:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039ba5b20/0x3e0030720b207608 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.719645:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039ba5b20/0x3e0030720b207608 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.719666:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.719673:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.719675:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851402.720209:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851402.720216:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d85f67/0x3e0030720b20760f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720226:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1788851402.720229:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851402.720234:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034d85f67/0x3e0030720b20760f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720244:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034d85f67/0x3e0030720b20760f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720253:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d85f67/0x3e0030720b20760f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720259:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034d85f67/0x3e0030720b20760f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720275:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.720284:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.720288:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034d85f67/0x3e0030720b20760f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720295:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.720298:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d85f67/0x3e0030720b20760f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720318:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d85f67/0x3e0030720b20760f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720330:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034d85f67/0x3e0030720b20760f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720337:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034d85f67/0x3e0030720b20760f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720351:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.720353:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.720354:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851402.720866:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851402.720874:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b207616 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720884:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1788851402.720888:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851402.720893:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b207616 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720903:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b207616 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.720985:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b207616 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.721001:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b207616 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.721036:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.721047:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.721052:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b207616 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.721060:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.721063:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b207616 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.721072:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b207616 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.721090:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b207616 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.721098:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c426aeb3/0x3e0030720b207616 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.721113:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.721115:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.721117:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851402.723351:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851402.723391:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b20761d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.723411:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1788851402.723416:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851402.723423:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b20761d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.723439:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b20761d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.723450:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b20761d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.723458:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b20761d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.723491:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.723513:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.723519:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b20761d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788851402.723999:0:22764:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788851402.724038:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788851402.724250:0:22785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788851402.724255:0:22785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788851402.724281:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.724296:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207560 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.724302:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebff94200/0x3e0030720b207575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b20756e expref: 24 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.724308:0:22785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.724344:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebff94200/0x3e0030720b207575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b20756e expref: 24 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851402.724356:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:25092:x1875746019865600:12345-0@lo:253:mount.lustre.0 Request processed in 22211us (24037us total) trans 0 rc 0/0 00010000:00010000:0.0:1788851402.724359:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ebff94200/0x3e0030720b207575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b20756e expref: 24 pid: 22763 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851402.724366:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788851402.724370:0:22785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019865728:0@lo:104: 00000100:00100000:0.0:1788851402.724406:0:22785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851402.724432:0:25092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc4a524f-5762-4d21-be7e-dbb6f41ca491:25092:1875746019865600:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788851402.724446:0:25092:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788851402.724450:0:25092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:0.0:1788851402.724450:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b207560 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788851402.724452:0:25092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788851402.724454:0:25092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851402.724455:0:25092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851402.724456:0:25092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851402.724458:0:25092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:0.0:1788851402.724458:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b207560 expref: 23 pid: 22764 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788851402.724459:0:25092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788851402.724461:0:25092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851402.724463:0:25092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788851402.724466:0:22785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019865856:0@lo:104: 00000020:02000000:3.0:1788851402.724481:0:25092:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788851402.724485:0:22785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851402.724500:0:22785:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e9831d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788851402.724923:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019865728 00000100:00100000:2.0:1788851402.724931:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019865728 00000100:00100000:2.0:1788851402.724967:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019865856 00000100:00100000:2.0:1788851402.724971:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019865856 00000100:00100000:2.0:1788851402.724996:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788851402.725003:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+4:22785:x1875746019865728:12345-0@lo:104: 00010000:00010000:2.0:1788851402.725030:0:22753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b207575 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.725088:0:22753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788851402.725094:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+4:22785:x1875746019865728:12345-0@lo:104: Request processed in 92us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851402.725100:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788851402.725114:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788851402.725119:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+3:22785:x1875746019865856:12345-0@lo:104: 00010000:00010000:2.0:1788851402.725126:0:22753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b207567 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.725151:0:22753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788851402.725156:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+3:22785:x1875746019865856:12345-0@lo:104: Request processed in 38us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851402.725162:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788851402.725181:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851402.725711:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.725716:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b20761d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.725729:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b20761d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.725756:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b20761d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.725763:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b20761d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.725783:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.725787:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b207567 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.725793:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ebe00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851402.725797:0:22757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b207567 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.725803:0:22757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b207567 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851402.725809:0:22757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b207567 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851402.725815:0:22757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788851402.725845:0:22757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b207567 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.725852:0:22757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851402.725871:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b207567 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.725888:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827ebe00/0x3e0030720b207560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b207567 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.725898:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.725899:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.725901:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851402.726392:0:22785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019865728:0@lo:104: 00000100:00100000:0.0:1788851402.726410:0:22785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1875746019865856:0@lo:104: 00010000:00010000:0.0:1788851402.726439:0:22785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851402.728712:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851402.728752:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e85694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019865984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851402.728837:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.728917:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019865984 00000100:00100000:1.0:1788851402.728926:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019865984 00010000:00010000:1.0:1788851402.728964:0:22756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207560 expref: 24 pid: 22764 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851402.729009:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788851402.729033:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:3649:x1875746019865984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851402.729050:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851402.729056:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207560 expref: 24 pid: 22764 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.729067:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b207560 expref: 24 pid: 22764 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.729086:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebbdaa800/0x3e0030720b207567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b207560 expref: 24 pid: 22764 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.729101:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851402.729140:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:3649:x1875746019865984:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851402.729159:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788851402.729201:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019865984:0@lo:103:ldlm_bl.0 00002000:00010000:0.0:1788851402.729275:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851402.729283:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b20762b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.729297:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1788851402.729301:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851402.729307:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b20762b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.729322:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b20762b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.729332:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b20762b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.729340:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b20762b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.729360:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851402.729788:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851402.729797:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b20762b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.729806:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851402.729811:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b20762b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.729833:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b20762b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.729850:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b20762b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.729857:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b20762b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.729879:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b207575 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.729886:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827eae00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:2.0:1788851402.729890:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b207575 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.729897:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b207575 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788851402.729903:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b207575 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851402.729909:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788851402.729945:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b207575 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.729952:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788851402.729988:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b207575 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.729995:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827eae00/0x3e0030720b20756e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b207575 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730008:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851402.730037:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851402.730039:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851402.730053:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851402.730066:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3648:1875746019866112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851402.730112:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851402.730151:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019866112 00000100:00100000:2.0:1788851402.730156:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019866112 00010000:00010000:2.0:1788851402.730176:0:22755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebff94200/0x3e0030720b207575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20756e expref: 23 pid: 22763 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851402.730196:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788851402.730203:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:3648:x1875746019866112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851402.730212:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851402.730217:0:22755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebff94200/0x3e0030720b207575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b20756e expref: 23 pid: 22763 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730225:0:22755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebff94200/0x3e0030720b207575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b20756e expref: 23 pid: 22763 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730235:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff94200/0x3e0030720b207575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b20756e expref: 23 pid: 22763 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730246:0:22755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730260:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788851402.730272:0:22755:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011485417s 00010000:00010000:2.0:1788851402.730277:0:22755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730282:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730289:0:22755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730295:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730300:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851402.730302:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730308:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730321:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730329:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851402.730357:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:3648:x1875746019866112:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851402.730363:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788851402.730393:0:22785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730400:0:22785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851402.730406:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebbdab400/0x3e0030720b207624 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851402.730435:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3648:1875746019866112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851402.730448:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851402.730451:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851402.730453:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.731039:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788851402.732705:0:25092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788851402.735392:0:25092:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788851402.735402:0:25092:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788851402.735444:0:25092:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788851402.735496:0:25092:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788851402.735515:0:25092:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788851402.735551:0:25092:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788851402.737052:0:25092:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788851402.737311:0:25092:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00002000:00010000:0.0:1788851402.775260:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851402.775277:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d05babf/0x3e0030720b207632 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.775295:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=736s v=(0 0) 00010000:00010000:0.0:1788851402.775312:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851402.775319:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d05babf/0x3e0030720b207632 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.775334:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d05babf/0x3e0030720b207632 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.775346:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d05babf/0x3e0030720b207632 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.775355:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d05babf/0x3e0030720b207632 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.775378:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851402.775390:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851402.775396:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d05babf/0x3e0030720b207632 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.775404:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851402.775409:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d05babf/0x3e0030720b207632 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.775418:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d05babf/0x3e0030720b207632 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.775434:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d05babf/0x3e0030720b207632 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.775453:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d05babf/0x3e0030720b207632 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.775473:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851402.775475:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851402.775476:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.791159:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.791176:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207639 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.791193:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.791199:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.791205:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207639 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.791222:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207639 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.791233:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207639 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.791247:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207639 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.791268:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851402.792711:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.792723:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b207640 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.792739:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.792743:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.792749:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b207640 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.792761:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b207640 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.792771:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b207640 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.792778:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b207640 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.792804:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788851402.793213:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.793220:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207647 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.793235:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.793237:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.793241:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207647 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.793250:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207647 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.793258:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207647 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.793265:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207647 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.793285:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788851402.793651:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788851402.793659:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207639 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793668:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433cc00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.793672:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207639 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793681:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207639 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793698:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207639 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793706:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207639 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793723:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851402.793727:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b207640 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793734:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.793738:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b207640 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793752:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b207640 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793761:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b207640 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793768:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b207640 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793777:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.793780:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207647 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793785:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433dc00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.793787:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207647 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793793:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207647 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793800:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207647 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793806:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207647 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.793830:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.793832:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.793833:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851402.794159:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851402.794363:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.794709:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.794719:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20764e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.794730:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.794734:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.794740:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20764e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.794751:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20764e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.794773:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20764e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.794781:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20764e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.794793:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.795033:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.795039:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20764e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.795047:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.795052:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20764e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.795061:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20764e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.795078:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20764e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.795085:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20764e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.795101:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.795103:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.795104:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851402.796498:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851402.796509:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b207655 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.809799:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=736s v=(0 0) 00010000:00010000:1.0:1788851402.809805:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851402.809814:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b207655 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.809833:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b207655 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.809846:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b207655 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.809854:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b207655 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.810173:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.810441:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.810448:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b207655 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.810458:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.810463:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b207655 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.810473:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b207655 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.810501:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b207655 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.810509:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022086dfb/0x3e0030720b207655 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.810530:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.810532:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.810534:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.816235:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.816252:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20765c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.816270:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.816275:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.816281:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20765c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.816296:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20765c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.816306:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20765c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.816313:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20765c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.816356:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851402.816996:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.817004:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207663 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.817035:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.817039:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.817043:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207663 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.817053:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207663 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.817061:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207663 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.817069:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207663 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.817082:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788851402.819234:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.819249:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b20766a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.819266:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.819284:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.819290:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b20766a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.819304:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b20766a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.819316:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b20766a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.819323:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b20766a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.819344:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788851402.819866:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788851402.819875:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20765c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.819884:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433d000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.819888:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20765c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.819899:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20765c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.819929:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20765c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.819936:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d688eca1/0x3e0030720b20765c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.819982:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851402.819987:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207663 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.819993:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433dc00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.819997:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207663 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.820006:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207663 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.820032:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207663 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.820039:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bacde6a/0x3e0030720b207663 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.820050:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.820053:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b20766a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.820058:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433c600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.820061:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b20766a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.820078:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b20766a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.820087:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b20766a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.820093:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a5a92f/0x3e0030720b20766a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.820105:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.820107:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.820109:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.820116:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.820120:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.821860:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.821874:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207671 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.821891:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.821896:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.821959:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207671 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.821986:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207671 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.821997:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207671 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.822040:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.822062:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.822421:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.822428:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.822437:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433cc00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.822441:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.822451:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207671 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.822470:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207671 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.822484:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086e2dcb3/0x3e0030720b207671 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.822504:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.822506:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.822508:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.822886:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.822893:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b207678 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.822919:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.822923:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.822928:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b207678 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.822938:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b207678 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.822947:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b207678 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.822955:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b207678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.822981:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.823143:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.823149:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b207678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.823157:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ea433de00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.823161:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b207678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.823169:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b207678 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.823181:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b207678 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.823189:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000781c44b1/0x3e0030720b207678 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.823203:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.823205:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.823207:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.823474:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.823481:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20767f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.823494:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.823497:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.823502:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20767f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.823511:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20767f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.823519:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20767f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.823543:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20767f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.823561:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.823727:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.823733:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20767f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.823741:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.823745:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20767f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.823754:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20767f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.823765:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20767f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.823773:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000397fb369/0x3e0030720b20767f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.823788:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.823790:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.823791:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.824214:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.824221:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001327ca50/0x3e0030720b207686 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.824230:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.824233:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.824236:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001327ca50/0x3e0030720b207686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.824245:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001327ca50/0x3e0030720b207686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.824264:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001327ca50/0x3e0030720b207686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.824271:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001327ca50/0x3e0030720b207686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.824291:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.824425:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.824431:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001327ca50/0x3e0030720b207686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.824439:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.824442:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001327ca50/0x3e0030720b207686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.824461:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001327ca50/0x3e0030720b207686 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.824474:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001327ca50/0x3e0030720b207686 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.824481:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001327ca50/0x3e0030720b207686 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.824496:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.824498:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.824500:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.825089:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.825097:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000079dcb28/0x3e0030720b20768d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.825107:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.825110:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.825114:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000079dcb28/0x3e0030720b20768d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.825122:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000079dcb28/0x3e0030720b20768d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.825129:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000079dcb28/0x3e0030720b20768d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.825136:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000079dcb28/0x3e0030720b20768d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.825162:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.825427:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.825433:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000079dcb28/0x3e0030720b20768d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.825442:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.825446:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000079dcb28/0x3e0030720b20768d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.825453:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000079dcb28/0x3e0030720b20768d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.825466:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000079dcb28/0x3e0030720b20768d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.825486:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000079dcb28/0x3e0030720b20768d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.825503:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.825505:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.825507:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.825947:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.825954:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008de4bca5/0x3e0030720b207694 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.825964:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.825968:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.825983:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008de4bca5/0x3e0030720b207694 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.825994:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008de4bca5/0x3e0030720b207694 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.826003:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008de4bca5/0x3e0030720b207694 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.826114:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008de4bca5/0x3e0030720b207694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.826166:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851402.826471:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.826477:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5ed3779/0x3e0030720b20769b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.826486:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.826494:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.826498:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5ed3779/0x3e0030720b20769b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.826507:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5ed3779/0x3e0030720b20769b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.826515:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5ed3779/0x3e0030720b20769b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.826522:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5ed3779/0x3e0030720b20769b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.826724:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851402.826730:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008de4bca5/0x3e0030720b207694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.826738:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7a00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.826742:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008de4bca5/0x3e0030720b207694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.826751:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008de4bca5/0x3e0030720b207694 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.826765:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008de4bca5/0x3e0030720b207694 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.826772:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008de4bca5/0x3e0030720b207694 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.826785:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.826788:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5ed3779/0x3e0030720b20769b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.826800:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.826802:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5ed3779/0x3e0030720b20769b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.826810:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5ed3779/0x3e0030720b20769b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.826820:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5ed3779/0x3e0030720b20769b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.826829:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.826830:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.826832:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851402.826895:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788851402.826900:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5ed3779/0x3e0030720b20769b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851402.827762:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.827771:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b2076a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.827782:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.827786:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.827790:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b2076a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.827800:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b2076a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.827816:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b2076a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.827824:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b2076a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.827902:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.827919:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b2076a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.827927:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.827930:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b2076a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.827938:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b2076a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.827951:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b2076a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.827966:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.827967:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.827969:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851402.830728:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788851402.830744:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4814d55/0x3e0030720b2076a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.831095:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.831499:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.831507:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091022119/0x3e0030720b2076a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.831521:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.831627:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.831635:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091022119/0x3e0030720b2076a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.831650:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091022119/0x3e0030720b2076a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.831661:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091022119/0x3e0030720b2076a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.831682:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091022119/0x3e0030720b2076a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.831702:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851402.831967:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.831985:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091022119/0x3e0030720b2076a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.831994:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.832008:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091022119/0x3e0030720b2076a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.832036:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091022119/0x3e0030720b2076a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.832053:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091022119/0x3e0030720b2076a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.832060:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091022119/0x3e0030720b2076a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.832080:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.832082:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.832083:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.832225:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.832231:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000798efa5b/0x3e0030720b2076b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.832240:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.832244:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.832248:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000798efa5b/0x3e0030720b2076b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.832257:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000798efa5b/0x3e0030720b2076b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.832265:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000798efa5b/0x3e0030720b2076b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.832272:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000798efa5b/0x3e0030720b2076b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.832293:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851402.832672:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.832678:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b177df83/0x3e0030720b2076b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.832696:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.832699:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.832704:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b177df83/0x3e0030720b2076b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.832713:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b177df83/0x3e0030720b2076b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.832723:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b177df83/0x3e0030720b2076b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.832729:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b177df83/0x3e0030720b2076b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.832742:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788851402.834457:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851402.834469:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000798efa5b/0x3e0030720b2076b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.834495:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.834500:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000798efa5b/0x3e0030720b2076b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.834509:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000798efa5b/0x3e0030720b2076b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851402.834812:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.834820:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000851540fe/0x3e0030720b2076be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.834830:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.834834:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.834841:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000851540fe/0x3e0030720b2076be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.834853:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000851540fe/0x3e0030720b2076be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.834875:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000851540fe/0x3e0030720b2076be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.834883:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000851540fe/0x3e0030720b2076be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.834916:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788851402.835083:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000798efa5b/0x3e0030720b2076b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.835092:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000798efa5b/0x3e0030720b2076b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.835112:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851402.835115:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b177df83/0x3e0030720b2076b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.835121:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.835124:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b177df83/0x3e0030720b2076b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.835132:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b177df83/0x3e0030720b2076b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.835142:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b177df83/0x3e0030720b2076b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.835154:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b177df83/0x3e0030720b2076b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.835165:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851402.835167:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000851540fe/0x3e0030720b2076be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.835173:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851402.835175:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000851540fe/0x3e0030720b2076be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.835182:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000851540fe/0x3e0030720b2076be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.835190:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000851540fe/0x3e0030720b2076be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.835197:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000851540fe/0x3e0030720b2076be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851402.835207:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.835208:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.835210:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851402.835222:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851402.835494:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.836230:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.836238:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd41326/0x3e0030720b2076c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.836252:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.836256:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.836261:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd41326/0x3e0030720b2076c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.836272:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd41326/0x3e0030720b2076c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.836282:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd41326/0x3e0030720b2076c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.836290:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bd41326/0x3e0030720b2076c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.836315:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851402.836434:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851402.836449:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bd41326/0x3e0030720b2076c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.836457:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851402.836460:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd41326/0x3e0030720b2076c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.836468:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd41326/0x3e0030720b2076c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.836482:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bd41326/0x3e0030720b2076c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.836489:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd41326/0x3e0030720b2076c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.836505:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851402.836507:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851402.836508:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851402.836938:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.836945:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2076cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.836954:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.836963:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.836967:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2076cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.836989:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2076cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.837004:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2076cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.837029:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2076cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.837044:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851402.837398:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.837404:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3d3dd4b/0x3e0030720b2076d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.837412:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.837415:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.837419:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d3dd4b/0x3e0030720b2076d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.837428:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3d3dd4b/0x3e0030720b2076d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.837435:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3d3dd4b/0x3e0030720b2076d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.837462:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d3dd4b/0x3e0030720b2076d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.837476:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788851402.838280:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788851402.838288:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fb68ab1/0x3e0030720b2076da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.838300:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=736s v=(0 0) 00010000:00010000:3.0:1788851402.838303:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851402.838308:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fb68ab1/0x3e0030720b2076da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.838319:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fb68ab1/0x3e0030720b2076da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.838329:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fb68ab1/0x3e0030720b2076da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.838337:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fb68ab1/0x3e0030720b2076da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851402.838347:0:24280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788851402.838860:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788851402.838870:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2076cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.838881:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851402.838885:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2076cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.838896:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2076cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788851402.838900:0:24280:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:0.0:1788851402.838915:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2076cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.838922:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dcddbba/0x3e0030720b2076cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.838945:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851402.838959:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3d3dd4b/0x3e0030720b2076d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.838966:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851402.838981:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3d3dd4b/0x3e0030720b2076d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.838989:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3d3dd4b/0x3e0030720b2076d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.839001:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3d3dd4b/0x3e0030720b2076d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.839008:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3d3dd4b/0x3e0030720b2076d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.839038:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851402.839041:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fb68ab1/0x3e0030720b2076da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.839048:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851402.839051:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fb68ab1/0x3e0030720b2076da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.839059:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fb68ab1/0x3e0030720b2076da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.839080:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fb68ab1/0x3e0030720b2076da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851402.839087:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fb68ab1/0x3e0030720b2076da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851402.839212:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22795:x1875746019865344:12345-0@lo:5:osp-pre-0-0.0 Request processed in 142038us (150303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851402.839228:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788851402.839271:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851402.839346:0:22795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e85695180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22795:1875746019865344:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788851402.839371:0:22795:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788851402.839419:0:22795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22795:1875746019866240:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788851402.839457:0:22795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851402.839481:0:22795:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c9540 going to sleep for 11 seconds 00010000:00010000:0.0:1788851402.839651:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851402.839653:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851402.839655:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851402.839664:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851402.844260:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019866240 00000100:00100000:2.0:1788851402.844277:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019866240 00000100:00100000:2.0:1788851402.844342:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788851402.844352:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22795:x1875746019866240:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788851402.844408:0:24765:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:1.0:1788851402.866750:0:24275:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1788851402.866812:0:24275:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788851402.877289:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22795:x1875746019866240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 32926us (37818us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788851402.877306:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788851402.877370:0:22795:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788851402.877379:0:22795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22795:1875746019866240:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788851402.877397:0:22795:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000040:00080000:1.0:1788851403.445646:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788851403.831286:0:22766:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788851403.831297:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892eb6cf0800 from 14 10000000:01000000:0.0:1788851403.831303:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788851403.831365:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b2076e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851403.831378:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b2076e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851403.831391:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b2076e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851403.831424:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019866368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851403.831529:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851403.831579:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84bf6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788851403.831630:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019866368 00000100:00100000:1.0:1788851403.831639:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019866368 00000100:00100000:1.0:1788851403.831690:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788851403.831707:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89069850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:22766:x1875746019866368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851403.831722:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851403.831737:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80031600/0x3e0030720b2076e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2076e1 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851403.831763:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80031600/0x3e0030720b2076e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2076e1 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851403.831774:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80031600/0x3e0030720b2076e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2076e1 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851403.831782:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031600, rc 0) 00000100:00100000:1.0:1788851403.831827:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89069850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:22766:x1875746019866368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851403.831832:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788851403.832008:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019866368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851403.832048:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b2076e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2076e8 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851403.832057:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b2076e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2076e8 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851403.832102:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019866496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788851403.832129:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851403.832144:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84bf6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851403.832193:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019866496 00000100:00100000:2.0:1788851403.832197:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019866496 00000100:00100000:2.0:1788851403.832221:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788851403.832233:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89068450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:22766:x1875746019866496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788851403.832247:0:22764:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788851403.832264:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788851403.832267:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788851403.832340:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89068450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:22766:x1875746019866496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851403.832347:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788851403.832397:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019866496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788851403.832450:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788851403.832457:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b2076e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2076e8 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851403.832466:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebbdaaa00/0x3e0030720b2076e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2076e8 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851403.832476:0:22766:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788851403.832477:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff892d89078800 from 14 10000000:01000000:0.0:1788851403.832480:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788851403.832494:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdaae00/0x3e0030720b2076ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851403.832502:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892ebbdaae00/0x3e0030720b2076ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851403.832518:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892ebbdaae00/0x3e0030720b2076ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851403.832530:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019866624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851403.832552:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851403.832577:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84bf6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851403.832611:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019866624 00000100:00100000:2.0:1788851403.832614:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019866624 00000100:00100000:2.0:1788851403.832642:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788851403.832647:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89069450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:22766:x1875746019866624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851403.832654:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851403.832662:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ebff95200/0x3e0030720b2076f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2076ef expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851403.832679:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ebff95200/0x3e0030720b2076f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2076ef expref: 24 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851403.832688:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ebff95200/0x3e0030720b2076f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2076ef expref: 24 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851403.832704:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95200, rc 0) 00000100:00100000:2.0:1788851403.832730:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89069450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:22766:x1875746019866624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851403.832736:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788851403.832759:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019866624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851403.832767:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892ebbdaae00/0x3e0030720b2076ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2076f6 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851403.832784:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892ebbdaae00/0x3e0030720b2076ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2076f6 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851403.832815:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019866752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788851403.832837:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851403.832848:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e84bfac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851403.832857:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019866752 00000100:00100000:2.0:1788851403.832859:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019866752 00000100:00100000:2.0:1788851403.832873:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788851403.832878:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:22766:x1875746019866752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788851403.832886:0:22763:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788851403.832895:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788851403.832898:0:22763:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788851403.832968:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:22766:x1875746019866752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 89us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851403.832975:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788851403.832999:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019866752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788851403.833058:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788851403.833064:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892ebbdaae00/0x3e0030720b2076ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2076f6 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851403.833072:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892ebbdaae00/0x3e0030720b2076ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2076f6 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851403.904045:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788851403.921962:0:25161:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788851403.922378:0:25161:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788851404.922634:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851405.944115:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851406.780211:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851406.780265:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019866880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851406.780340:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851406.780642:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019866880 00000100:00100000:0.0:1788851406.780651:0:24282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019866880 00000100:00100000:0.0:1788851406.780717:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851406.780729:0:24282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019866880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788851406.780759:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788851406.780805:0:24282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019866880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851406.780812:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851406.780857:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019866880:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788851406.781250:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788851406.967522:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851407.796189:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d8839b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019867008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851407.796263:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851407.796327:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851407.796335:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019867136:0@lo:400:kworker.0 00000100:00080000:1.0:1788851407.796339:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851407.796346:0:23321:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788851407.796350:0:23321:0:(import.c:65:import_set_state_nolock()) ffff892eb6998800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851407.796364:0:23321:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff892eb6998800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1788851407.796369:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851407.796389:0:23321:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5995f80 x1875746019867520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851407.796408:0:23778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019867008 00000100:00100000:3.0:1788851407.796416:0:23778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019867008 00000100:00080000:1.0:1788851407.796432:0:23321:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851407.796436:0:23321:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788851407.796438:0:23321:0:(import.c:65:import_set_state_nolock()) ffff892e90e54000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851407.796445:0:23321:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff892e90e54000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1788851407.796458:0:23321:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff892ea5996300 x1875746019867904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851407.796460:0:23778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788851407.796469:0:23778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019867008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851407.796498:0:23778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788851407.796532:0:23778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019867008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851407.796539:0:23778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788851407.796558:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019867136 00000100:00100000:3.0:1788851407.796561:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019867136 00000100:00100000:3.0:1788851407.796583:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788851407.796590:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89068050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:3649:x1875746019867136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851407.796616:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89068050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:3649:x1875746019867136:12345-0@lo:400:kworker.0 Request processed in 27us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851407.796633:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788851407.796664:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019867776:0@lo:400:kworker.0 00000100:00100000:1.0:1788851407.796825:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019867392:0@lo:400:kworker.0 00000100:00100000:1.0:1788851407.796857:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851407.797043:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019868160:0@lo:400:kworker.0 00000100:00100000:1.0:1788851407.797070:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851407.797089:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019868672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851407.797108:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851407.797127:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788851407.797131:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019867264:0@lo:400:kworker.0 00000100:00100000:1.0:1788851407.797151:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851407.797167:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019868032:0@lo:400:kworker.0 00000100:00100000:1.0:1788851407.797199:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851407.797215:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019868544:0@lo:400:kworker.0 00000100:00100000:1.0:1788851407.797592:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851407.797622:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019867520:0@lo:8:kworker.0 00000100:00100000:1.0:1788851407.797644:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851407.797661:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019867904:0@lo:8:kworker.0 00000100:00100000:1.0:1788851407.797679:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851407.797707:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019868160 00000100:00100000:1.0:1788851407.797714:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019868160 00000100:00100000:1.0:1788851407.797749:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019868032 00000100:00100000:1.0:1788851407.797752:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019868032 00000100:00100000:1.0:1788851407.797762:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019868544 00000100:00100000:1.0:1788851407.797764:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019868544 00000100:00100000:1.0:1788851407.797777:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788851407.797783:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019868160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851407.797938:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875746019868160:12345-0@lo:400:kworker.0 Request processed in 154us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851407.797945:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788851407.797960:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788851407.797966:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019868032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851407.797990:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875746019868032:12345-0@lo:400:kworker.0 Request processed in 24us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851407.797995:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788851407.798005:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788851407.798033:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019868544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851407.798061:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875746019868544:12345-0@lo:400:kworker.0 Request processed in 50us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851407.798075:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788851407.798096:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019868672 00000100:00100000:1.0:1788851407.798100:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019868672 00000100:00100000:1.0:1788851407.798119:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019867264 00000100:00100000:1.0:1788851407.798122:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019867264 00000100:00100000:1.0:1788851407.798132:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788851407.798136:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019868672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788851407.798158:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788851407.798189:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019868672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851407.798195:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788851407.798206:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788851407.798212:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019867264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851407.798858:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851407.798901:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019868416:0@lo:400:kworker.0 00000100:00100000:3.0:1788851407.798929:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851407.798952:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788851407.798960:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019867648:0@lo:400:kworker.0 00000100:00100000:3.0:1788851407.798985:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851407.798997:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019868288:0@lo:400:kworker.0 00000100:00100000:3.0:1788851407.799042:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851407.799053:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019868800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851407.799081:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851407.799116:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019867392 00000100:00100000:3.0:1788851407.799122:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019867392 00000100:00100000:3.0:1788851407.799155:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019867520 00000100:00100000:3.0:1788851407.799159:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019867520 00000100:00100000:3.0:1788851407.799169:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019867904 00000100:00100000:3.0:1788851407.799172:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019867904 00000100:00100000:3.0:1788851407.799181:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019867776 00000100:00100000:3.0:1788851407.799183:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019867776 00000100:00100000:3.0:1788851407.799198:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851407.799206:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019867392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851407.799242:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019867392:12345-0@lo:400:kworker.0 Request processed in 37us (2384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851407.799248:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851407.799260:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788851407.799275:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019867776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851407.799308:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019867776:12345-0@lo:400:kworker.0 Request processed in 33us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851407.799314:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788851407.799324:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788851407.799328:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875746019867520:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788851407.799354:0:24281:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 741 last 0 00000020:00000080:3.0:1788851407.799382:0:24281:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e0030720b2076fd 00002000:00100000:3.0:1788851407.799395:0:24281:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff892d8745c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788851407.799400:0:24281:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788851407.799402:0:24281:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788851407.799602:0:24281:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1788851407.799615:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019868800 00000100:00100000:0.0:1788851407.799621:0:24282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019868800 00000100:00080000:3.0:1788851407.799631:0:24281:0:(import.c:65:import_set_state_nolock()) ffff892d8745d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851407.799656:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851407.799665:0:24282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019868800:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851407.799681:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875746019867520:12345-0@lo:8:kworker.0 Request processed in 350us (2034us total) trans 0 rc 0/0 00002000:00000024:0.0:1788851407.799681:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788851407.799691:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788851407.799708:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788851407.799712:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875746019867904:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788851407.799729:0:24281:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 741 last 0 00000020:00000080:3.0:1788851407.799748:0:24281:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x3e0030720b207704 00002000:00100000:3.0:1788851407.799755:0:24281:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff892d87458000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788851407.799759:0:24281:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788851407.799761:0:24281:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788851407.799791:0:24281:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788851407.799804:0:24281:0:(import.c:65:import_set_state_nolock()) ffff892d8745e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851407.799857:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1875746019867904:12345-0@lo:8:kworker.0 Request processed in 144us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851407.799864:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788851407.799927:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5995f80 x1875746019867520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788851432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788851407.799941:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788851407.799948:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788851407.799953:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788851407.799955:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892eb6998800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788851407.799969:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788851407.799973:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875746019867520:0@lo:8:kworker.0 00010000:00080000:3.0:1788851407.799986:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5996300 x1875746019867904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788851432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788851407.799994:0:3646:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788851407.800000:0:3646:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788851407.800002:0:3646:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788851407.800004:0:3646:0:(import.c:65:import_set_state_nolock()) ffff892e90e54000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788851407.800036:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788851407.800040:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875746019867904:0@lo:8:kworker.0 00000004:00080000:3.0:1788851407.800069:0:22796:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788851407.800135:0:22796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 741859121563ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788851407.800141:0:22796:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788851407.800185:0:23515:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788851407.800202:0:23515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23515:1875746019869056:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788851407.800232:0:23515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851407.800247:0:23515:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb67c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851407.800365:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019867264:12345-0@lo:400:kworker.0 Request processed in 2151us (3211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851407.800374:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788851407.800400:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019869056 00000100:00100000:1.0:1788851407.800405:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019868416 00000100:00100000:3.0:1788851407.800406:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019869056 00000100:00100000:1.0:1788851407.800412:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019868416 00000100:00100000:3.0:1788851407.800442:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788851407.800442:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019867648 00000100:00100000:1.0:1788851407.800447:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019867648 00000100:00100000:3.0:1788851407.800453:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23515:x1875746019869056:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788851407.800640:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019867136:0@lo:400:kworker.0 00000100:00100000:0.0:1788851407.800647:0:24282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019868800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 980us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851407.800657:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788851407.800664:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d8839b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019867008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851407.800684:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851407.800690:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019868928:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788851407.800709:0:22797:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1788851407.800722:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851407.800729:0:22797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22797:1875746019869312:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788851407.800753:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019868288 00000100:00100000:3.0:1788851407.800759:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019868288 00000100:00100000:0.0:1788851407.800768:0:22797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851407.800787:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788851407.800790:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8146ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851407.800797:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019868416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851407.800833:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019868416:12345-0@lo:400:kworker.0 Request processed in 39us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851407.800839:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788851407.800852:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788851407.800858:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019867648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851407.800895:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875746019867648:12345-0@lo:400:kworker.0 Request processed in 38us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851407.800901:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788851407.800912:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788851407.800921:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019868288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851407.800946:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019868288:12345-0@lo:400:kworker.0 Request processed in 27us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851407.800960:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788851407.800977:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019869312 00000100:00100000:3.0:1788851407.803404:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019869312 00000100:00100000:3.0:1788851407.803483:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788851407.803493:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22797:x1875746019869312:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1788851407.804401:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851407.804408:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851407.804413:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851407.804416:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851407.804533:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019867264:0@lo:400:kworker.0 00010000:00080000:1.0:1788851407.804557:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5997b80 x1875746019868032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851407.804584:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875746019868032:0@lo:400:kworker.0 00010000:00080000:1.0:1788851407.804600:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5995880 x1875746019868544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851407.804608:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875746019868544:0@lo:400:kworker.0 00000100:00100000:1.0:1788851407.804621:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019867392:0@lo:400:kworker.0 00010000:00080000:1.0:1788851407.804632:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5997100 x1875746019868160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851407.804641:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875746019868160:0@lo:400:kworker.0 00000100:00100000:1.0:1788851407.804656:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019868672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788851407.804689:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788851407.804699:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019869184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851407.804753:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851407.804928:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019868928 00000100:00100000:0.0:1788851407.804936:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019868928 00000100:00100000:0.0:1788851407.804964:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019869184 00000100:00100000:0.0:1788851407.804967:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019869184 00000100:00100000:0.0:1788851407.804982:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851407.804991:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875746019868928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788851407.805036:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788851407.805089:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875746019868928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (4367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851407.805096:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851407.805113:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788851407.805119:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875746019869184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851407.805129:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788851407.805156:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875746019869184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851407.805163:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788851407.805183:0:23514:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:1.0:1788851407.805647:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea74e4a80 x1875746019869184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851407.805666:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019869184:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788851407.805774:0:23514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 741864760224ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788851407.805782:0:23514:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:3.0:1788851407.806602:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5996300 x1875746019868928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851407.806625:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5996300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019868928:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788851407.806667:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5995500 x1875746019867648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851407.807970:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875746019867648:0@lo:400:kworker.0 00002000:00080000:3.0:1788851407.810633:0:24281:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788851407.810642:0:24281:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000004:00080000:0.0:1788851407.811621:0:22749:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788851407.812069:0:23503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00080000:2.0:1788851407.813604:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5994a80 x1875746019868288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851407.813637:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019868288:0@lo:400:kworker.0 00000100:00100000:2.0:1788851407.813668:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019868800:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788851407.813686:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5997480 x1875746019868416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851407.813694:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019868416:0@lo:400:kworker.0 00000100:00100000:2.0:1788851407.813705:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019867776:0@lo:400:kworker.0 00002000:00080000:0.0:1788851407.815111:0:24765:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788851407.815126:0:24765:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788851407.815134:0:24765:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000100:00100000:3.0:1788851407.815178:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23515:x1875746019869056:12345-0@lo:7:osp-pre-1-1.0 Request processed in 14723us (14940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851407.815194:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788851407.815252:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea5995f80 x1875746019869056/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788851423 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851407.815268:0:23515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5995f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23515:1875746019869056:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788851407.815286:0:23515:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788851407.815545:0:23515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23515:1875746019869440:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788851407.815580:0:23515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851407.815610:0:23515:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86ae70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851407.815624:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019869440 00000100:00100000:3.0:1788851407.815636:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019869440 00000100:00100000:3.0:1788851407.815689:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788851407.815698:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23515:x1875746019869440:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788851407.815725:0:24278:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788851407.815758:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23515:x1875746019869440:12345-0@lo:5:osp-pre-1-1.0 Request processed in 61us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851407.815764:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788851407.815787:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88284a80 x1875746019869440/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788851423 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851407.815796:0:23515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23515:1875746019869440:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788851407.815804:0:23515:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788851407.815826:0:23515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23515:1875746019869568:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788851407.815844:0:23515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851407.815856:0:23515:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d86ae70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851407.815866:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019869568 00000100:00100000:3.0:1788851407.815869:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019869568 00000100:00100000:3.0:1788851407.815898:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788851407.815903:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23515:x1875746019869568:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788851407.815926:0:24278:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:1.0:1788851407.844826:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.844841:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20770b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.844859:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.844864:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.844890:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20770b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.844911:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20770b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.844922:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20770b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.844931:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20770b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.844959:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851407.844988:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851407.844995:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20770b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.845003:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031a00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.845008:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20770b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.845046:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20770b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.845064:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20770b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.845085:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20770b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.845105:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.845107:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.845109:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851407.846233:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.846246:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207712 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.846262:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.846266:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.846273:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.846284:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.846295:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.846303:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.846326:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788851407.846795:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.846865:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207719 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.846884:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.846888:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.846893:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207719 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.846902:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207719 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.846911:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207719 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.846918:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207719 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.846940:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788851407.846956:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851407.846961:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.846969:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.846975:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.846983:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207712 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.847009:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207712 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.847041:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207712 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.847059:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851407.847063:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207719 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.847070:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.847073:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207719 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.847081:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207719 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.847091:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207719 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.847099:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207719 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.847110:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.847113:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.847121:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851407.849032:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851407.850347:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.850361:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b207720 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.850379:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.850384:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.850391:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b207720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.850405:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b207720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.850417:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b207720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.850426:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b207720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.850447:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851407.850459:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851407.850992:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b207720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.851001:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.851005:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b207720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.851056:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b207720 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.851075:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b207720 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.851083:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b207720 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.851107:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.851110:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.851112:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851407.852684:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.852695:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207727 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.852710:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.852714:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.852719:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207727 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.852732:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207727 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.852741:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207727 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.852756:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.852771:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851407.852783:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851407.852788:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.852796:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.852800:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.852815:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207727 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.852832:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207727 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.852839:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207727 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.852853:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.852855:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.852856:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851407.855044:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.855063:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f042ff84/0x3e0030720b20772e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.855078:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.855083:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.855088:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f042ff84/0x3e0030720b20772e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.855102:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f042ff84/0x3e0030720b20772e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.855113:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f042ff84/0x3e0030720b20772e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.855121:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f042ff84/0x3e0030720b20772e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.855144:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851407.855647:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851407.855655:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f042ff84/0x3e0030720b20772e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.855664:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851407.855669:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f042ff84/0x3e0030720b20772e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.855678:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f042ff84/0x3e0030720b20772e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.855701:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f042ff84/0x3e0030720b20772e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.855708:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f042ff84/0x3e0030720b20772e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.855742:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.855744:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.855746:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851407.858391:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.858404:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039ba5b20/0x3e0030720b207735 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.858421:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.858426:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.858433:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039ba5b20/0x3e0030720b207735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.858448:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039ba5b20/0x3e0030720b207735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.859111:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039ba5b20/0x3e0030720b207735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.859122:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039ba5b20/0x3e0030720b207735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.859144:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851407.859348:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851407.859356:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039ba5b20/0x3e0030720b207735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.859379:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851407.859385:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039ba5b20/0x3e0030720b207735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.859396:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039ba5b20/0x3e0030720b207735 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.859419:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039ba5b20/0x3e0030720b207735 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.859426:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039ba5b20/0x3e0030720b207735 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.859448:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.859450:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.859451:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851407.860773:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.860785:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b20773c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.860800:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.860804:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.860817:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b20773c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.860831:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b20773c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.860841:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b20773c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.860849:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b20773c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.860892:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851407.861640:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851407.861650:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b20773c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.861661:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851407.861666:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b20773c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.861676:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b20773c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.861698:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b20773c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.861706:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006806ab9f/0x3e0030720b20773c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.861726:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.861728:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.861730:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851407.862660:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.862668:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207743 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.862680:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.862683:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.862689:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.862700:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.862710:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.862717:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.862739:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851407.864612:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851407.864625:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.864653:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851407.864659:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.864671:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207743 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.864693:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207743 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.864702:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009470b7c4/0x3e0030720b207743 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.864729:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.864731:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.864734:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851407.868751:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851407.868766:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b20774a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.868784:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=741s v=(0 0) 00010000:00010000:0.0:1788851407.868789:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851407.868796:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b20774a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.868823:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b20774a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.868843:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b20774a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.868852:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b20774a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.868887:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851407.869433:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851407.869442:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b20774a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.869452:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdaa800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.869477:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b20774a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.869489:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b20774a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.869511:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b20774a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.869520:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b20774a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.869543:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.869546:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.869548:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851407.871077:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.871089:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207751 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.871104:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.871109:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.871116:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207751 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.871129:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207751 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.871141:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207751 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.871160:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207751 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.871180:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851407.875656:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851407.875672:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207751 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.875688:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851407.875693:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207751 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.875706:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207751 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.875737:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207751 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.875745:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008966fb7e/0x3e0030720b207751 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.875768:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.875769:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.875771:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851407.877173:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.877186:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207758 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.877203:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.877208:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.877215:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.877239:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.877249:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.877257:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.877275:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851407.878176:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851407.878184:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.878195:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851407.878200:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.878210:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207758 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.878227:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207758 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.878234:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e9dc1c8/0x3e0030720b207758 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.878263:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.878265:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.878267:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851407.878636:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.878643:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20775f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.878658:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.878662:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.878667:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20775f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.878676:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20775f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.878685:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20775f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.878692:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20775f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.878716:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851407.879937:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851407.879948:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20775f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.879959:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031a00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851407.879963:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20775f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.879971:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20775f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.879989:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20775f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.879997:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e172ad5/0x3e0030720b20775f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.880031:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.880033:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.880035:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788851407.886003:0:25093:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1788851407.886059:0:25093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788851407.886065:0:25093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788851407.886234:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23515:x1875746019869568:12345-0@lo:5:osp-pre-1-1.0 Request processed in 70326us (70384us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788851407.886246:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788851407.886514:0:23515:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788851407.886524:0:23515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23515:1875746019869568:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788851407.886542:0:23515:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788851407.886606:0:23515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23515:1875746019869696:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788851407.886641:0:23515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851407.886663:0:23515:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d87bee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851407.886685:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019869696 00000100:00100000:0.0:1788851407.886691:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019869696 00000100:00100000:0.0:1788851407.886731:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851407.886740:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23515:x1875746019869696:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788851407.886785:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23515:x1875746019869696:12345-0@lo:900:osp-pre-1-1.0 Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851407.886791:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788851407.887134:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892ea74e7800 x1875746019869696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788851423 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851407.887161:0:23515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23515:1875746019869696:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1788851407.888157:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851407.888169:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b207766 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.888197:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=741s v=(0 0) 00010000:00010000:2.0:1788851407.888202:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851407.888209:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b207766 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.888290:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b207766 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.888301:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b207766 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.888308:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b207766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.888428:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851407.892092:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851407.892105:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b207766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.892119:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.892124:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b207766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.892136:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b207766 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.892171:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b207766 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.892178:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b207766 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.892200:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.892202:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.892204:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851407.894542:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.894559:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b20776d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.894578:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.894584:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.894590:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b20776d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.894605:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b20776d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.894616:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b20776d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.894625:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b20776d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.894706:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788851407.895791:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788851407.895803:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022086dfb/0x3e0030720b207774 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.895887:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=741s v=(0 0) 00010000:00010000:1.0:1788851407.895891:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851407.895897:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022086dfb/0x3e0030720b207774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.895912:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022086dfb/0x3e0030720b207774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.895922:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022086dfb/0x3e0030720b207774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.895930:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022086dfb/0x3e0030720b207774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.896032:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851407.896042:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b20776d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.896050:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851407.896055:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b20776d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.896065:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b20776d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.896085:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b20776d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.896093:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c426aeb3/0x3e0030720b20776d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.896113:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851407.896117:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022086dfb/0x3e0030720b207774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.896123:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851407.896126:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022086dfb/0x3e0030720b207774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.896147:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022086dfb/0x3e0030720b207774 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.896157:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022086dfb/0x3e0030720b207774 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.896166:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.896167:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.896169:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.896382:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788851407.896388:0:24765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022086dfb/0x3e0030720b207774 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851407.897256:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851407.897266:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d05babf/0x3e0030720b20777b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.897278:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=741s v=(0 0) 00010000:00010000:0.0:1788851407.897281:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851407.897287:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d05babf/0x3e0030720b20777b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.897298:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d05babf/0x3e0030720b20777b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.897307:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d05babf/0x3e0030720b20777b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.897315:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d05babf/0x3e0030720b20777b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.897740:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851407.897748:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d05babf/0x3e0030720b20777b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.897758:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851407.897762:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d05babf/0x3e0030720b20777b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.897771:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d05babf/0x3e0030720b20777b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.897799:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d05babf/0x3e0030720b20777b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.897819:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.897820:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.897822:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.897972:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851407.897979:0:24765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d05babf/0x3e0030720b20777b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851407.898522:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851407.898530:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f369018/0x3e0030720b207782 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.898541:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=741s v=(0 0) 00010000:00010000:0.0:1788851407.898545:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851407.898551:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f369018/0x3e0030720b207782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.898563:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f369018/0x3e0030720b207782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.898572:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f369018/0x3e0030720b207782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.898580:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f369018/0x3e0030720b207782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.898935:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851407.898943:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f369018/0x3e0030720b207782 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.898958:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.898961:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f369018/0x3e0030720b207782 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.898969:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f369018/0x3e0030720b207782 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.898985:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f369018/0x3e0030720b207782 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.898994:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.898995:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.898997:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.899474:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851407.899482:0:24765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f369018/0x3e0030720b207782 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851407.900179:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851407.900187:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b207789 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.900200:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=741s v=(0 0) 00010000:00010000:0.0:1788851407.900204:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851407.900209:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b207789 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.900221:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b207789 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.900417:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b207789 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.900425:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b207789 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.900762:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851407.900769:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b207789 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.900778:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdaa800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851407.900784:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b207789 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.900793:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b207789 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.900927:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b207789 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.900939:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.900941:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.900943:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.901050:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851407.901056:0:24765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052ca72c9/0x3e0030720b207789 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851407.901774:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851407.901784:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a76ea8c9/0x3e0030720b207790 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.901822:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=741s v=(0 0) 00010000:00010000:0.0:1788851407.901826:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851407.901833:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a76ea8c9/0x3e0030720b207790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.901845:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a76ea8c9/0x3e0030720b207790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.901856:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a76ea8c9/0x3e0030720b207790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.901864:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a76ea8c9/0x3e0030720b207790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.901994:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851407.902000:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a76ea8c9/0x3e0030720b207790 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.902034:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab400 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851407.902038:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a76ea8c9/0x3e0030720b207790 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.902047:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a76ea8c9/0x3e0030720b207790 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.902060:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a76ea8c9/0x3e0030720b207790 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.902068:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.902070:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.902072:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.902178:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851407.902183:0:24765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a76ea8c9/0x3e0030720b207790 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851407.903640:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851407.903651:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cdc163/0x3e0030720b207797 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.903666:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=741s v=(0 0) 00010000:00010000:0.0:1788851407.903670:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851407.903676:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013cdc163/0x3e0030720b207797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.903704:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013cdc163/0x3e0030720b207797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.903715:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cdc163/0x3e0030720b207797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.903722:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013cdc163/0x3e0030720b207797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.904407:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851407.904416:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013cdc163/0x3e0030720b207797 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.904426:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab600 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.904431:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cdc163/0x3e0030720b207797 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.904440:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cdc163/0x3e0030720b207797 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.904457:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013cdc163/0x3e0030720b207797 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.904547:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.904548:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.904550:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.904668:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851407.904674:0:24765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013cdc163/0x3e0030720b207797 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851407.905173:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788851407.905180:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043defdd5/0x3e0030720b20779e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.905190:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=741s v=(0 0) 00010000:00010000:0.0:1788851407.905194:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851407.905198:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043defdd5/0x3e0030720b20779e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.905210:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043defdd5/0x3e0030720b20779e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.905241:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043defdd5/0x3e0030720b20779e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.905248:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043defdd5/0x3e0030720b20779e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.905656:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851407.905664:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043defdd5/0x3e0030720b20779e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.905672:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebb200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:2.0:1788851407.905675:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043defdd5/0x3e0030720b20779e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.905684:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043defdd5/0x3e0030720b20779e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.905699:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043defdd5/0x3e0030720b20779e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.905715:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.905717:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.905719:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.905802:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788851407.905896:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.905918:0:24765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043defdd5/0x3e0030720b20779e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851407.906583:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851407.906591:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b2077a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.906601:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=741s v=(0 0) 00010000:00010000:2.0:1788851407.906605:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851407.906610:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b2077a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.906622:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b2077a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.906631:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b2077a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.906640:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b2077a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.906702:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788851407.907050:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851407.907055:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb309f8d/0x3e0030720b2077ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.907075:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=741s v=(0 0) 00010000:00010000:2.0:1788851407.907078:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851407.907082:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb309f8d/0x3e0030720b2077ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.907091:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb309f8d/0x3e0030720b2077ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.907099:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb309f8d/0x3e0030720b2077ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.907107:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb309f8d/0x3e0030720b2077ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.907384:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851407.907391:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b2077a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.907399:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.907404:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b2077a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.907412:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b2077a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.907427:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b2077a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.907434:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000452df3c6/0x3e0030720b2077a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.907450:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851407.907454:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb309f8d/0x3e0030720b2077ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.907471:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.907481:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb309f8d/0x3e0030720b2077ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.907489:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb309f8d/0x3e0030720b2077ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.907500:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb309f8d/0x3e0030720b2077ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.907507:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.907508:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.907510:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.907636:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788851407.907642:0:24765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb309f8d/0x3e0030720b2077ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851407.908055:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851407.908061:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000654d9865/0x3e0030720b2077b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.908070:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=741s v=(0 0) 00010000:00010000:2.0:1788851407.908074:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851407.908078:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000654d9865/0x3e0030720b2077b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.908098:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000654d9865/0x3e0030720b2077b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.908107:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000654d9865/0x3e0030720b2077b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.908115:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000654d9865/0x3e0030720b2077b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.908189:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851407.908195:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000654d9865/0x3e0030720b2077b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.908202:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95a00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851407.908206:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000654d9865/0x3e0030720b2077b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.908214:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000654d9865/0x3e0030720b2077b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.908306:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000654d9865/0x3e0030720b2077b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.908316:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.908324:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.908326:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.908384:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788851407.908389:0:24765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000654d9865/0x3e0030720b2077b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851407.908745:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851407.908752:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2077ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.908761:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=741s v=(0 0) 00010000:00010000:2.0:1788851407.908764:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851407.908769:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2077ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.908778:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2077ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.908797:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2077ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.908861:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2077ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.908903:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851407.908909:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2077ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.908915:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95000 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.908919:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2077ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.908927:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2077ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.908941:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2077ba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.908949:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.908957:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.908959:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851407.909111:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788851407.909116:0:24765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05024af/0x3e0030720b2077ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.909456:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788851407.909520:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851407.909526:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c839c775/0x3e0030720b2077c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.909535:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=741s v=(0 0) 00010000:00010000:2.0:1788851407.909537:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851407.909542:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c839c775/0x3e0030720b2077c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.909551:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c839c775/0x3e0030720b2077c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.909559:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c839c775/0x3e0030720b2077c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.909573:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c839c775/0x3e0030720b2077c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.909586:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851407.909611:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851407.909617:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c839c775/0x3e0030720b2077c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.909624:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94800 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851407.909628:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c839c775/0x3e0030720b2077c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.909636:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c839c775/0x3e0030720b2077c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.909648:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c839c775/0x3e0030720b2077c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.909656:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c839c775/0x3e0030720b2077c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.909779:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.909782:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.909784:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788851407.909864:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851407.909871:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ecc085d/0x3e0030720b2077c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.909891:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=741s v=(0 0) 00010000:00010000:2.0:1788851407.909894:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851407.909898:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ecc085d/0x3e0030720b2077c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.909908:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ecc085d/0x3e0030720b2077c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.909916:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ecc085d/0x3e0030720b2077c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.909923:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ecc085d/0x3e0030720b2077c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.909945:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851407.910177:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851407.910183:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ecc085d/0x3e0030720b2077c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.910192:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.910195:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ecc085d/0x3e0030720b2077c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.910204:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ecc085d/0x3e0030720b2077c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.910217:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ecc085d/0x3e0030720b2077c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.910478:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ecc085d/0x3e0030720b2077c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.910506:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.910508:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.910510:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788851407.910573:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851407.910580:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2077cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.910596:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=741s v=(0 0) 00010000:00010000:2.0:1788851407.910599:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851407.910603:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2077cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.910613:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2077cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.910620:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2077cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.910627:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2077cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.910646:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851407.910667:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851407.910672:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2077cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.910679:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851407.910689:0:25110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2077cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.910697:0:25110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2077cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.910708:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2077cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.910715:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072900b7e/0x3e0030720b2077cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851407.910728:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.910730:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851407.910731:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788851407.910975:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851407.910980:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068b55c40/0x3e0030720b2077d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.910988:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=741s v=(0 0) 00010000:00010000:2.0:1788851407.910991:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851407.910995:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068b55c40/0x3e0030720b2077d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.911003:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068b55c40/0x3e0030720b2077d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.911048:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068b55c40/0x3e0030720b2077d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.911055:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068b55c40/0x3e0030720b2077d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.911068:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851407.911350:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851407.911356:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068b55c40/0x3e0030720b2077d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.911365:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2155200 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851407.911369:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068b55c40/0x3e0030720b2077d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.911383:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068b55c40/0x3e0030720b2077d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.911395:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068b55c40/0x3e0030720b2077d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.911402:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068b55c40/0x3e0030720b2077d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.911417:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.911419:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.911420:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788851407.911672:0:24765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788851407.911678:0:24765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021668e71/0x3e0030720b2077dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.911686:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=741s v=(0 0) 00010000:00010000:2.0:1788851407.911690:0:24765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851407.911694:0:24765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021668e71/0x3e0030720b2077dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.911704:0:24765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021668e71/0x3e0030720b2077dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.911711:0:24765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021668e71/0x3e0030720b2077dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.911718:0:24765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021668e71/0x3e0030720b2077dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851407.911754:0:24765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788851407.911791:0:24765:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:2.0:1788851407.911907:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22797:x1875746019869312:12345-0@lo:5:osp-pre-1-0.0 Request processed in 108412us (111136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851407.911917:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788851407.912353:0:22797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22797:1875746019869312:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788851407.912373:0:22797:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788851407.912431:0:22797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22797:1875746019869824:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788851407.912478:0:22797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851407.912510:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ea59a7780 going to sleep for 11 seconds 00010000:00010000:0.0:1788851407.912527:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851407.912533:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021668e71/0x3e0030720b2077dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.912542:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2154c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851407.912545:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021668e71/0x3e0030720b2077dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.912567:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021668e71/0x3e0030720b2077dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.912583:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021668e71/0x3e0030720b2077dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.912590:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021668e71/0x3e0030720b2077dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851407.912610:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.912612:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851407.912614:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851407.913407:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019869824 00000100:00100000:2.0:1788851407.913419:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019869824 00000100:00100000:2.0:1788851407.913483:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788851407.913493:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22797:x1875746019869824:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788851407.913546:0:24281:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1788851407.916902:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22797:x1875746019869824:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3398us (4410us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788851407.916918:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788851407.917286:0:22797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22797:1875746019869824:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788851407.917309:0:22797:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:2.0:1788851407.988235:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851409.013763:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788851409.478332:0:25451:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788851410.046814:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851410.486983:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1788851410.592450:0:25503:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851410.592677:0:25503:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788851411.061536:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788851411.721266:0:25553:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788851411.721462:0:25553:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788851411.894657:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019869952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788851411.894733:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851411.894815:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019869952 00000100:00100000:1.0:1788851411.894823:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019869952 00000100:00100000:1.0:1788851411.894880:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788851411.894889:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019869952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788851411.894919:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788851411.894964:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019869952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851411.894985:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788851411.895006:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851411.895067:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019869952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788851411.941357:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851411.941509:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000879104 00000100:00100000:3.0:1788851411.941523:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000879104 00000100:00100000:3.0:1788851411.941588:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 114 00000100:00100000:3.0:1788851411.941597:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2406:x1875746000879104:12345-192.168.204.27@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788851411.941630:0:22764:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5@192.168.204.27@tcp t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:3.0:1788851411.941662:0:22764:0:(genops.c:1384:class_connect()) connect: client 7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5, cookie 0x3e0030720b2077e4 00000100:00080000:3.0:1788851411.941840:0:22764:0:(import.c:65:import_set_state_nolock()) ffff892ebbb76800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851411.941919:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+5:2406:x1875746000879104:12345-192.168.204.27@tcp:250:mount.lustre.0 Request processed in 321us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851411.941927:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 114 00000100:00100000:3.0:1788851411.950996:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851411.951055:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000879232 00000100:00100000:3.0:1788851411.951066:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000879232 00000100:00100000:3.0:1788851411.951117:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:3.0:1788851411.951128:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+5:18089:x1875746000879232:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788851411.951148:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851411.951180:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e7000/0x3e0030720b2077eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38fbb expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851411.951209:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e7000/0x3e0030720b2077eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38fbb expref: 6 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851411.951220:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e7000/0x3e0030720b2077eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38fbb expref: 6 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851411.951230:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7000, rc 0) 00000100:00100000:3.0:1788851411.951282:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+6:18089:x1875746000879232:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 156us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851411.951289:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:2.0:1788851411.965486:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851411.966267:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000879360 00000100:00100000:1.0:1788851411.966278:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000879360 00000100:00100000:1.0:1788851411.966337:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:1.0:1788851411.966346:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+6:18089:x1875746000879360:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788851411.967448:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+6:18089:x1875746000879360:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 1097us (1970us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788851411.967460:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:1.0:1788851411.978181:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851411.978223:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000879488 00000100:00100000:1.0:1788851411.978231:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000879488 00000100:00100000:1.0:1788851411.978275:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:1.0:1788851411.978284:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8799ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+6:18089:x1875746000879488:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788851411.978299:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851411.978315:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80031000/0x3e0030720b2077f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38fc2 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851411.978343:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80031000/0x3e0030720b2077f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38fc2 expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851411.978354:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80031000/0x3e0030720b2077f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38fc2 expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851411.979859:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031000, rc 0) 00000100:00100000:2.0:1788851411.986142:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8799ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+7:18089:x1875746000879488:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 7848us (7957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851411.986154:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:0.0:1788851411.989171:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851411.989240:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000879616 00000100:00100000:2.0:1788851411.989253:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000879616 00000100:00100000:2.0:1788851411.989314:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:2.0:1788851411.989324:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+7:18089:x1875746000879616:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788851411.989494:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+8:18089:x1875746000879616:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 171us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851411.989501:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:3.0:1788851411.991544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851411.991932:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000879744 00000100:00100000:2.0:1788851411.991942:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000879744 00000100:00100000:2.0:1788851411.991999:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:2.0:1788851411.992009:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8799bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+8:18089:x1875746000879744:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788851411.992169:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8799bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+8:18089:x1875746000879744:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 161us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851411.992177:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:3.0:1788851412.008177:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851412.008263:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000879872 00000100:00100000:0.0:1788851412.008273:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000879872 00000100:00100000:0.0:1788851412.008374:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:0.0:1788851412.008385:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+8:18108:x1875746000879872:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788851412.008578:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+8:18108:x1875746000879872:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 194us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851412.008587:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:2.0:1788851412.037682:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851412.037845:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000880000 00000100:00100000:1.0:1788851412.037856:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000880000 00000100:00100000:1.0:1788851412.037914:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:1.0:1788851412.037925:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8799b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+8:18108:x1875746000880000:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788851412.042613:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8799b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+8:18108:x1875746000880000:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 4677us (4927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851412.042630:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:3.0:1788851412.059871:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851412.060489:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000880128 00000100:00100000:0.0:1788851412.060513:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000880128 00000100:00100000:0.0:1788851412.060577:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:0.0:1788851412.060588:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8799a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+8:18108:x1875746000880128:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788851412.061491:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8799a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+8:18108:x1875746000880128:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 899us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851412.061502:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:2.0:1788851412.067697:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851412.067806:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000880256 00000100:00100000:3.0:1788851412.067816:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000880256 00000100:00100000:3.0:1788851412.067910:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:3.0:1788851412.067921:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+8:18089:x1875746000880256:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788851412.067937:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851412.067954:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e6800/0x3e0030720b2077f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ff3 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851412.067984:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e6800/0x3e0030720b2077f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ff3 expref: 9 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851412.067997:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e6800/0x3e0030720b2077f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ff3 expref: 9 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851412.068005:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6800, rc 0) 00000100:00100000:3.0:1788851412.068563:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+9:18089:x1875746000880256:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 641us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851412.068573:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:0.0:1788851412.071483:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851412.071621:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000880384 00000100:00100000:1.0:1788851412.071631:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000880384 00000100:00100000:1.0:1788851412.071734:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:1.0:1788851412.071744:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8799a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+9:18089:x1875746000880384:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788851412.071768:0:22763:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788851412.071801:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788851412.071806:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788851412.071809:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788851412.071812:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788851412.071814:0:22763:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788851412.073936:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8799a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+9:18089:x1875746000880384:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 2181us (2452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851412.073955:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:3.0:1788851412.080082:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851412.080275:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000880512 00000100:00100000:2.0:1788851412.080286:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000880512 00000100:00100000:2.0:1788851412.080389:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:2.0:1788851412.080400:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8799b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+9:18089:x1875746000880512:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788851412.080418:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851412.080438:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ec2154800/0x3e0030720b207800 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c38ffa expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851412.080471:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2154800/0x3e0030720b207800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ffa expref: 10 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851412.080483:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ec2154800/0x3e0030720b207800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ffa expref: 10 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851412.080491:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2154800, rc 0) 00000100:00100000:2.0:1788851412.080567:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8799b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+10:18089:x1875746000880512:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 169us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.080574:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:0.0:1788851412.083187:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851412.083255:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000880640 00000100:00100000:1.0:1788851412.083265:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000880640 00000100:00100000:1.0:1788851412.083322:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:1.0:1788851412.083331:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+10:18089:x1875746000880640:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788851412.083655:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+10:18089:x1875746000880640:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 323us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851412.083664:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 126 00010000:00010000:2.0:1788851412.084502:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851412.086098:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851412.086234:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000880768 00000100:00100000:2.0:1788851412.086244:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000880768 00000100:00100000:2.0:1788851412.086469:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:2.0:1788851412.086482:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+10:18089:x1875746000880768:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788851412.086640:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+10:18089:x1875746000880768:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 161us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.086649:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:3.0:1788851412.089896:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851412.090116:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000880896 00000100:00100000:1.0:1788851412.090127:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000880896 00000100:00100000:1.0:1788851412.090220:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:1.0:1788851412.090244:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+10:18114:x1875746000880896:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788851412.090510:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+10:18114:x1875746000880896:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 267us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851412.090519:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:0.0:1788851412.092845:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851412.093044:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000881024 00000100:00100000:2.0:1788851412.093054:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000881024 00000100:00100000:2.0:1788851412.093195:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:2.0:1788851412.093207:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+10:18114:x1875746000881024:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851412.093367:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+10:18114:x1875746000881024:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 151us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.093376:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:0.0:1788851412.108565:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851412.108670:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851412.108708:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000881152 00000100:00100000:3.0:1788851412.108720:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000881152 00000100:00100000:3.0:1788851412.108804:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000881408 00000100:00100000:3.0:1788851412.108808:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000881408 00000100:00100000:3.0:1788851412.108833:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1788851412.108842:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1875746000881152:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788851412.108873:0:22769:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0844575f-19e7-4df3-8155-eb6a1666d628@192.168.204.27@tcp t0 exp 0000000000000000 cur 746 last 0 00000020:00000080:3.0:1788851412.108922:0:22769:0:(genops.c:1384:class_connect()) connect: client 0844575f-19e7-4df3-8155-eb6a1666d628, cookie 0x3e0030720b207807 00000004:00100000:3.0:1788851412.109058:0:22769:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788851412.110745:0:22769:0:(import.c:65:import_set_state_nolock()) ffff892d86bd3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851412.110848:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+6:2406:x1875746000881152:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 2003us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.110859:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1788851412.110896:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:2.0:1788851412.110902:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1875746000881408:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788851412.110927:0:22769:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 0844575f-19e7-4df3-8155-eb6a1666d628@192.168.204.27@tcp t0 exp 0000000000000000 cur 746 last 0 00000020:00000080:2.0:1788851412.110987:0:22769:0:(genops.c:1384:class_connect()) connect: client 0844575f-19e7-4df3-8155-eb6a1666d628, cookie 0x3e0030720b20780e 00000004:00100000:2.0:1788851412.111054:0:22769:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788851412.111244:0:22769:0:(import.c:65:import_set_state_nolock()) ffff892d86bd0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851412.111274:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+6:2406:x1875746000881408:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 371us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.111281:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:0.0:1788851412.118669:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851412.119044:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000881664 00000100:00100000:1.0:1788851412.119055:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000881664 00000100:00100000:1.0:1788851412.119139:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:1.0:1788851412.119149:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+6:18089:x1875746000881664:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788851412.119199:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788851412.119294:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+6:18089:x1875746000881664:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 146us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851412.119303:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00080000:2.0:1788851412.119992:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851412.124143:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851412.124187:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851412.124219:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000881536 00000100:00100000:2.0:1788851412.124230:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000881536 00000100:00100000:2.0:1788851412.124311:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000881280 00000100:00100000:2.0:1788851412.124315:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000881280 00000100:00100000:2.0:1788851412.124333:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:2.0:1788851412.124342:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+6:0:x1875746000881536:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788851412.124391:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788851412.124471:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+6:0:x1875746000881536:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 130us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.124478:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:2.0:1788851412.124496:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:2.0:1788851412.124502:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+6:0:x1875746000881280:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788851412.124513:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788851412.124542:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+6:0:x1875746000881280:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 41us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.124549:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00080000:3.0:1788851412.125581:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851412.125784:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851412.127988:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000881792 00000100:00100000:2.0:1788851412.128005:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000881792 00000100:00100000:2.0:1788851412.128121:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:2.0:1788851412.128146:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+6:18089:x1875746000881792:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788851412.128237:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+6:18089:x1875746000881792:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 93us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.128245:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:0.0:1788851412.131346:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851412.131391:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851412.131420:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851412.131500:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000881920 00000100:00100000:2.0:1788851412.131505:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000882176 00000100:00100000:2.0:1788851412.131510:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000882176 00000100:00100000:1.0:1788851412.131510:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000881920 00000100:00100000:2.0:1788851412.131549:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1788851412.131552:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000882048 00000100:00100000:1.0:1788851412.131554:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000882048 00000100:00100000:2.0:1788851412.131559:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0844575f-19e7-4df3-8155-eb6a1666d628+6:18089:x1875746000882176:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788851412.131572:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1788851412.131577:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1875746000881920:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788851412.131604:0:24765:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0844575f-19e7-4df3-8155-eb6a1666d628@192.168.204.27@tcp t0 exp 0000000000000000 cur 746 last 0 00000020:00000080:1.0:1788851412.131633:0:24765:0:(genops.c:1384:class_connect()) connect: client 0844575f-19e7-4df3-8155-eb6a1666d628, cookie 0x3e0030720b207815 00002000:00100000:1.0:1788851412.131644:0:24765:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0844575f-19e7-4df3-8155-eb6a1666d628/ffff892d85ce7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788851412.131654:0:24765:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788851412.131666:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0844575f-19e7-4df3-8155-eb6a1666d628+6:18089:x1875746000882176:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 107us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.131673:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:2.0:1788851412.131697:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:2.0:1788851412.131702:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875746000882048:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788851412.131715:0:24281:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0844575f-19e7-4df3-8155-eb6a1666d628@192.168.204.27@tcp t0 exp 0000000000000000 cur 746 last 0 00000020:00000080:2.0:1788851412.131740:0:24281:0:(genops.c:1384:class_connect()) connect: client 0844575f-19e7-4df3-8155-eb6a1666d628, cookie 0x3e0030720b20781c 00002000:00100000:2.0:1788851412.131745:0:24281:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0844575f-19e7-4df3-8155-eb6a1666d628/ffff892d881cd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788851412.131758:0:24281:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788851412.131841:0:24765:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788851412.131869:0:24765:0:(import.c:65:import_set_state_nolock()) ffff892d85ce3000 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1788851412.131889:0:24281:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1788851412.131896:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0844575f-19e7-4df3-8155-eb6a1666d628+6:2406:x1875746000881920:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 318us (505us total) trans 0 rc 0/0 00000100:00080000:2.0:1788851412.131902:0:24281:0:(import.c:65:import_set_state_nolock()) ffff892d881ca800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851412.131909:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:2.0:1788851412.131922:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+6:2406:x1875746000882048:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 219us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.132064:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1788851412.133957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851412.134062:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000882304 00000100:00100000:3.0:1788851412.134069:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000882304 00000100:00100000:3.0:1788851412.134116:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:3.0:1788851412.134125:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0844575f-19e7-4df3-8155-eb6a1666d628+6:18089:x1875746000882304:12345-192.168.204.27@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788851412.147868:0:22772:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13649us 00000004:00200000:1.0:1788851412.173465:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788851412.173600:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0844575f-19e7-4df3-8155-eb6a1666d628+6:18089:x1875746000882304:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 39471us (39644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851412.173615:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1788851412.324176:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851412.324535:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000882432 00000100:00100000:1.0:1788851412.324546:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000882432 00000100:00100000:1.0:1788851412.324645:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:1.0:1788851412.324656:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+6:18137:x1875746000882432:12345-192.168.204.27@tcp:101:mkdir.0 00010000:00010000:1.0:1788851412.324678:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851412.324704:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b207823 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c3902b expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851412.324780:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b20782a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851412.324804:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b20782a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851412.324828:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b20782a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851412.324890:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788851412.324895:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851412.324934:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b20782a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851412.324962:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b207823 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3902b expref: 8 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851412.325004:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b20782a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3902b expref: 7 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851412.325067:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e83031800) 00010000:00010000:1.0:1788851412.325070:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851412.325074:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031e00, rc 0) 00000100:00100000:1.0:1788851412.325270:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+7:18137:x1875746000882432:12345-192.168.204.27@tcp:101:mkdir.0 Request processed in 614us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851412.325278:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:1.0:1788851412.917514:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019870080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851412.917584:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851412.917645:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851412.917652:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019870208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851412.917675:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851412.917905:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019870208 00000100:00100000:2.0:1788851412.918051:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851412.918061:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019870336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851412.918115:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851412.918157:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019870080 00000100:00100000:2.0:1788851412.918160:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019870080 00000100:00100000:2.0:1788851412.918198:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019870336 00000100:00100000:2.0:1788851412.918201:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019870336 00000100:00100000:2.0:1788851412.918215:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788851412.918223:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019870080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788851412.918250:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788851412.918472:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019870208 00000100:00100000:1.0:1788851412.918512:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851412.918518:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019870208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788851412.918532:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788851412.918578:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019870208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851412.918584:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851412.918628:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019870208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851412.919099:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019870080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 875us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.919106:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788851412.919124:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788851412.919132:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019870336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851412.919146:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788851412.919178:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019870336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.919184:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788851412.919216:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019870336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788851412.919331:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851412.919352:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019870464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851412.919383:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851412.919431:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019870464 00000100:00100000:0.0:1788851412.919435:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019870464 00000100:00100000:0.0:1788851412.919462:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851412.919486:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875746019870464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851412.919498:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788851412.919527:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875746019870464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851412.919533:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851412.919561:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019870464:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788851412.920199:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851412.920613:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019870848:0@lo:400:kworker.0 00000100:00100000:3.0:1788851412.920658:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851412.920685:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019871360:0@lo:400:kworker.0 00000100:00100000:3.0:1788851412.920706:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851412.921148:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019870848 00000100:00100000:0.0:1788851412.921156:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019870848 00000100:00100000:0.0:1788851412.921209:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851412.921216:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019870848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851412.921263:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019870848:12345-0@lo:400:kworker.0 Request processed in 48us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851412.921270:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788851412.921298:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851412.922103:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019870848:0@lo:400:kworker.0 00000100:00100000:3.0:1788851412.922123:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788851412.922131:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019870976:0@lo:400:kworker.0 00000100:00100000:3.0:1788851412.922167:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851412.922187:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019871488:0@lo:400:kworker.0 00000100:00100000:3.0:1788851412.922205:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851412.922237:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019871360 00000100:00100000:0.0:1788851412.923163:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019870976 00000100:00100000:0.0:1788851412.923171:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019870976 00000100:00100000:0.0:1788851412.923211:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019871488 00000100:00100000:0.0:1788851412.923214:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019871488 00000100:00100000:0.0:1788851412.923242:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788851412.923251:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019870976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851412.923329:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019870976:12345-0@lo:400:kworker.0 Request processed in 79us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851412.923335:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788851412.923452:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3650:1875746019870720:0@lo:400:kworker.0 00000100:00100000:2.0:1788851412.923491:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851412.923524:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019871232:0@lo:400:kworker.0 00000100:00100000:2.0:1788851412.923545:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851412.923556:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019871744:0@lo:400:kworker.0 00000100:00100000:2.0:1788851412.923578:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851412.923591:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788851412.923610:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019870592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851412.923633:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851412.923650:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019871104:0@lo:400:kworker.0 00000100:00100000:2.0:1788851412.923669:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851412.923685:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d88284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019871616:0@lo:400:kworker.0 00000100:00100000:2.0:1788851412.923705:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851412.923740:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019870720 00000100:00100000:2.0:1788851412.923745:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019870720 00000100:00100000:2.0:1788851412.923771:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788851412.923788:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:3650:x1875746019870720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851412.924203:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019870080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851412.924238:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019871232 00000100:00100000:1.0:1788851412.924242:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019871232 00000100:00100000:1.0:1788851412.924259:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019871744 00000100:00100000:1.0:1788851412.924261:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019871744 00000100:00100000:1.0:1788851412.924273:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019871616 00000100:00100000:1.0:1788851412.924276:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019871616 00000100:00100000:1.0:1788851412.924289:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788851412.924295:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019871488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851412.924335:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019871488:12345-0@lo:400:kworker.0 Request processed in 39us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851412.924476:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788851412.924495:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788851412.924501:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019871232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851412.924538:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875746019871232:12345-0@lo:400:kworker.0 Request processed in 37us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851412.924544:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788851412.924557:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788851412.924562:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019871744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851412.924586:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875746019871744:12345-0@lo:400:kworker.0 Request processed in 25us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851412.924592:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788851412.924602:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788851412.924607:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019871616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851412.924629:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875746019871616:12345-0@lo:400:kworker.0 Request processed in 22us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851412.924635:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788851412.924672:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875746019871616:0@lo:400:kworker.0 00000100:00100000:1.0:1788851412.924683:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875746019871232:0@lo:400:kworker.0 00010000:00080000:1.0:1788851412.924693:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88285500 x1875746019871744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851412.924704:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875746019871744:0@lo:400:kworker.0 00000100:00080000:1.0:1788851412.924759:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851412.924763:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788851412.924797:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019870592 00000100:00100000:0.0:1788851412.926985:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019871104 00000100:00100000:0.0:1788851412.927002:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019871104 00000100:00100000:0.0:1788851412.927071:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851412.927082:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019871104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851412.927203:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019871104:12345-0@lo:400:kworker.0 Request processed in 123us (3532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851412.927211:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851412.927258:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019871104:0@lo:400:kworker.0 00000100:00100000:0.0:1788851412.927309:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019870976:0@lo:400:kworker.0 00010000:00080000:0.0:1788851412.927327:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d88284380 x1875746019871488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851412.927335:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019871488:0@lo:400:kworker.0 00000100:00100000:3.0:1788851412.927472:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019871360 00000100:00100000:3.0:1788851412.927524:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788851412.927531:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019871360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851412.927571:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875746019871360:12345-0@lo:400:kworker.0 Request processed in 41us (6863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851412.927577:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788851412.927606:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875746019871360:0@lo:400:kworker.0 00000100:00100000:2.0:1788851412.927812:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:3650:x1875746019870720:12345-0@lo:400:kworker.0 Request processed in 4033us (4318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851412.927822:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788851412.928103:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d88286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3650:1875746019870720:0@lo:400:kworker.0 00000100:00100000:1.0:1788851412.928186:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019870592 00000100:00100000:1.0:1788851412.928220:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788851412.928227:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019870592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851412.928244:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788851412.928294:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019870592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (4660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851412.928300:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788851412.928468:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019870592:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788851412.930157:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788851413.112492:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851413.686716:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1788851413.944393:0:25093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0844575f-19e7-4df3-8155-eb6a1666d628 00000001:00080000:0.0:1788851413.944411:0:25093:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:3.0:1788851414.132340:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851414.586860:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851414.586985:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000882560 00000100:00100000:0.0:1788851414.586996:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000882560 00000100:00100000:0.0:1788851414.587111:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:0.0:1788851414.587122:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+7:18189:x1875746000882560:12345-192.168.204.27@tcp:41:lfs.0 00000004:00000024:0.0:1788851414.587164:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788851414.587269:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+7:18189:x1875746000882560:12345-192.168.204.27@tcp:41:lfs.0 Request processed in 148us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851414.587277:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00080000:1.0:1788851414.587761:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851414.593944:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851414.594154:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000882688 00000100:00100000:3.0:1788851414.594166:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000882688 00000100:00100000:3.0:1788851414.594247:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:3.0:1788851414.594258:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+6:18189:x1875746000882688:12345-192.168.204.27@tcp:41:lfs.0 00000004:00000024:3.0:1788851414.594305:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788851414.594407:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+6:18189:x1875746000882688:12345-192.168.204.27@tcp:41:lfs.0 Request processed in 151us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851414.594417:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:1.0:1788851414.595514:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788851414.598662:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851414.598955:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000882816 00000100:00100000:1.0:1788851414.598968:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000882816 00000100:00100000:1.0:1788851414.599078:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:1.0:1788851414.599088:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0844575f-19e7-4df3-8155-eb6a1666d628+6:18189:x1875746000882816:12345-192.168.204.27@tcp:13:lfs.0 00002000:00000024:1.0:1788851414.599120:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788851414.599286:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0844575f-19e7-4df3-8155-eb6a1666d628+6:18189:x1875746000882816:12345-192.168.204.27@tcp:13:lfs.0 Request processed in 198us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851414.599294:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00080000:0.0:1788851414.599482:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851414.603353:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851414.603960:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000882944 00000100:00100000:1.0:1788851414.603971:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000882944 00000100:00100000:1.0:1788851414.604119:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:1.0:1788851414.604141:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0844575f-19e7-4df3-8155-eb6a1666d628+5:18189:x1875746000882944:12345-192.168.204.27@tcp:13:lfs.0 00002000:00000024:1.0:1788851414.604174:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788851414.604272:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0844575f-19e7-4df3-8155-eb6a1666d628+5:18189:x1875746000882944:12345-192.168.204.27@tcp:13:lfs.0 Request processed in 144us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851414.604280:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00080000:0.0:1788851414.608411:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851414.791485:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851414.791763:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000883072 00000100:00100000:2.0:1788851414.791783:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000883072 00000100:00100000:2.0:1788851414.791974:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:2.0:1788851414.791986:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+10:18219:x1875746000883072:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788851414.792004:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851414.792078:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ec2155a00/0x3e0030720b207831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c39032 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851414.792114:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2155a00/0x3e0030720b207831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39032 expref: 11 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851414.792152:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ec2155a00/0x3e0030720b207831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39032 expref: 11 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851414.792162:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2155a00, rc 0) 00000100:00100000:2.0:1788851414.792251:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18219:x1875746000883072:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 266us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851414.792258:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 131 00000100:00100000:3.0:1788851414.801579:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851414.804971:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000883200 00000100:00100000:2.0:1788851414.804989:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000883200 00000100:00100000:2.0:1788851414.805096:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:2.0:1788851414.805116:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18219:x1875746000883200:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788851414.805288:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18219:x1875746000883200:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 183us (3719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851414.805296:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:3.0:1788851414.809185:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851414.815753:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000883328 00000100:00100000:1.0:1788851414.815930:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000883328 00000100:00100000:1.0:1788851414.816008:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:0.0:1788851414.816621:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18219:x1875746000883328:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788851414.816830:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18219:x1875746000883328:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 651us (7655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851414.820415:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:3.0:1788851414.825088:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851414.825426:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000883456 00000100:00100000:2.0:1788851414.825437:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000883456 00000100:00100000:2.0:1788851414.825499:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:2.0:1788851414.825510:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18227:x1875746000883456:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851414.825701:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18227:x1875746000883456:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 192us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851414.825709:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:2.0:1788851414.870005:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851414.870147:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000883584 00000100:00100000:0.0:1788851414.870159:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000883584 00000100:00100000:0.0:1788851414.870221:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:0.0:1788851414.870231:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18227:x1875746000883584:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788851414.870400:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18227:x1875746000883584:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 170us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851414.870409:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:0.0:1788851414.883139:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851414.883318:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000883712 00000100:00100000:3.0:1788851414.883331:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000883712 00000100:00100000:3.0:1788851414.883395:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:3.0:1788851414.883423:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18227:x1875746000883712:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788851414.883605:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18227:x1875746000883712:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 184us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851414.883612:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:3.0:1788851414.887464:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851414.888052:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000883840 00000100:00100000:2.0:1788851414.888064:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000883840 00000100:00100000:2.0:1788851414.888115:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:2.0:1788851414.888138:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18219:x1875746000883840:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788851414.888154:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851414.888172:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ec2155200/0x3e0030720b207838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c39063 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851414.888200:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2155200/0x3e0030720b207838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39063 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851414.888212:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ec2155200/0x3e0030720b207838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39063 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851414.888221:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2155200, rc 0) 00000100:00100000:2.0:1788851414.888285:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+12:18219:x1875746000883840:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 149us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851414.888292:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:2.0:1788851414.897664:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851414.898622:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000883968 00000100:00100000:3.0:1788851414.898635:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000883968 00000100:00100000:3.0:1788851414.899039:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:3.0:1788851414.899051:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+12:18219:x1875746000883968:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788851414.899081:0:22761:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788851414.899111:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788851414.899116:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788851414.899120:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788851414.899137:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788851414.899140:0:22761:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788851414.902372:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+12:18219:x1875746000883968:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 3313us (4708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851414.902388:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:0.0:1788851414.906525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851414.906657:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000884096 00000100:00100000:1.0:1788851414.906668:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000884096 00000100:00100000:1.0:1788851414.906734:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:1.0:1788851414.906754:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+12:18219:x1875746000884096:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788851414.906773:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851414.907070:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e80030400/0x3e0030720b20783f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c3906a expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851414.907103:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e80030400/0x3e0030720b20783f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3906a expref: 13 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851414.907114:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e80030400/0x3e0030720b20783f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3906a expref: 13 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851414.907123:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030400, rc 0) 00000100:00100000:1.0:1788851414.907188:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18219:x1875746000884096:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 436us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851414.907212:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:3.0:1788851414.909627:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851414.909786:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000884224 00000100:00100000:2.0:1788851414.909875:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000884224 00000100:00100000:2.0:1788851414.909934:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:2.0:1788851414.909943:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18219:x1875746000884224:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788851414.910235:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18219:x1875746000884224:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 292us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851414.910244:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:3.0:1788851414.912485:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851414.912617:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000884352 00000100:00100000:2.0:1788851414.912644:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000884352 00000100:00100000:2.0:1788851414.912921:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:2.0:1788851414.912932:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18219:x1875746000884352:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788851414.913089:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18219:x1875746000884352:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 159us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851414.913097:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:3.0:1788851414.916474:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851414.916976:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000884480 00000100:00100000:2.0:1788851414.916987:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000884480 00000100:00100000:2.0:1788851414.917085:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:2.0:1788851414.917095:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18231:x1875746000884480:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851414.917247:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18231:x1875746000884480:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 152us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851414.917255:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:0.0:1788851414.926248:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851414.926358:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000884608 00000100:00100000:2.0:1788851414.926368:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000884608 00000100:00100000:2.0:1788851414.926435:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:2.0:1788851414.926445:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18231:x1875746000884608:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851414.926625:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18231:x1875746000884608:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 180us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851414.926633:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:3.0:1788851414.937556:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851414.937596:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851414.937622:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851414.937657:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851414.937680:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851414.937696:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851414.937806:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000884736 00000100:00100000:1.0:1788851414.937817:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000884736 00000100:00100000:1.0:1788851414.937854:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000884992 00000100:00100000:1.0:1788851414.937857:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000884992 00000100:00100000:1.0:1788851414.937866:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000885376 00000100:00100000:1.0:1788851414.937868:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000885376 00000100:00100000:1.0:1788851414.937891:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000885504 00000100:00100000:1.0:1788851414.937893:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000885504 00000100:00100000:1.0:1788851414.937909:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:1.0:1788851414.937918:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+7:2407:x1875746000885376:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851414.938002:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+7:2407:x1875746000885376:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 85us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851414.938046:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:1.0:1788851414.938067:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:1.0:1788851414.938073:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+6:2407:x1875746000885504:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851414.938099:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+6:2407:x1875746000885504:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851414.938105:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:1.0:1788851414.938117:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:1.0:1788851414.938122:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1875746000884736:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788851414.938149:0:22771:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b140db83-9b09-493c-aeff-0cdb002e3e74@192.168.204.27@tcp t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:1.0:1788851414.938182:0:22771:0:(genops.c:1384:class_connect()) connect: client b140db83-9b09-493c-aeff-0cdb002e3e74, cookie 0x3e0030720b207846 00000004:00100000:1.0:1788851414.938209:0:22771:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788851414.938302:0:22771:0:(import.c:65:import_set_state_nolock()) ffff892eb67b6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851414.938346:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+6:2406:x1875746000884736:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 223us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851414.938354:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:1.0:1788851414.938368:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:1.0:1788851414.938372:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1875746000884992:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788851414.938386:0:22771:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from b140db83-9b09-493c-aeff-0cdb002e3e74@192.168.204.27@tcp t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:1.0:1788851414.938409:0:22771:0:(genops.c:1384:class_connect()) connect: client b140db83-9b09-493c-aeff-0cdb002e3e74, cookie 0x3e0030720b20784d 00000004:00100000:1.0:1788851414.938421:0:22771:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788851414.938461:0:22771:0:(import.c:65:import_set_state_nolock()) ffff892eb67b2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851414.938484:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+6:2406:x1875746000884992:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 110us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851414.938490:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:0.0:1788851414.938959:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000885632 00000100:00100000:0.0:1788851414.938965:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000885632 00000100:00100000:0.0:1788851414.939042:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000885760 00000100:00100000:0.0:1788851414.939046:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000885760 00000100:00100000:0.0:1788851414.939064:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1788851414.939070:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0844575f-19e7-4df3-8155-eb6a1666d628+6:2407:x1875746000885632:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851414.939105:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0844575f-19e7-4df3-8155-eb6a1666d628+6:2407:x1875746000885632:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 36us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851414.939110:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1788851414.939123:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:0.0:1788851414.939129:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0844575f-19e7-4df3-8155-eb6a1666d628+5:2407:x1875746000885760:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851414.939151:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0844575f-19e7-4df3-8155-eb6a1666d628+5:2407:x1875746000885760:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 23us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851414.939156:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:3.0:1788851414.950079:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851414.950174:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851414.950513:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000884864 00000100:00100000:1.0:1788851414.950526:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000884864 00000100:00100000:1.0:1788851414.950608:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000885248 00000100:00100000:1.0:1788851414.950612:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000885248 00000100:00100000:1.0:1788851414.950629:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1788851414.950638:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+7:0:x1875746000884864:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788851414.950903:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788851414.950996:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+7:0:x1875746000884864:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 358us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851414.951005:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1788851414.951049:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1788851414.951057:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+6:18219:x1875746000885248:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788851414.951068:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788851414.951111:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+6:18219:x1875746000885248:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 55us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851414.951117:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00080000:2.0:1788851414.951187:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851414.955954:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851414.956137:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000885120 00000100:00100000:3.0:1788851414.956165:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000885120 00000100:00100000:3.0:1788851414.956281:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:3.0:1788851414.956291:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b140db83-9b09-493c-aeff-0cdb002e3e74+6:0:x1875746000885120:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788851414.956329:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788851414.956404:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b140db83-9b09-493c-aeff-0cdb002e3e74+6:0:x1875746000885120:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 114us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851414.956411:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00080000:2.0:1788851414.961044:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851414.964851:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851414.964919:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000885888 00000100:00100000:1.0:1788851414.964930:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000885888 00000100:00100000:1.0:1788851414.965000:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:1.0:1788851414.965033:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d88284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+6:18219:x1875746000885888:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788851414.965119:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d88284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+6:18219:x1875746000885888:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 109us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851414.965125:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1788851414.968707:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851414.968781:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851414.968954:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000886016 00000100:00100000:2.0:1788851414.968965:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000886016 00000100:00100000:2.0:1788851414.969008:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000886144 00000100:00100000:2.0:1788851414.969045:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000886144 00000100:00100000:2.0:1788851414.969087:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1788851414.969096:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1875746000886016:12345-192.168.204.27@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788851414.969114:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:1.0:1788851414.969122:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1875746000886144:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788851414.969132:0:24765:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b140db83-9b09-493c-aeff-0cdb002e3e74@192.168.204.27@tcp t0 exp 0000000000000000 cur 749 last 0 00010000:00080000:1.0:1788851414.969145:0:24280:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b140db83-9b09-493c-aeff-0cdb002e3e74@192.168.204.27@tcp t0 exp 0000000000000000 cur 749 last 0 00000020:00000080:2.0:1788851414.969169:0:24765:0:(genops.c:1384:class_connect()) connect: client b140db83-9b09-493c-aeff-0cdb002e3e74, cookie 0x3e0030720b207854 00000020:00000080:1.0:1788851414.969172:0:24280:0:(genops.c:1384:class_connect()) connect: client b140db83-9b09-493c-aeff-0cdb002e3e74, cookie 0x3e0030720b20785b 00002000:00100000:2.0:1788851414.969184:0:24765:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b140db83-9b09-493c-aeff-0cdb002e3e74/ffff892d881cf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788851414.969345:0:24765:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788851414.969422:0:24765:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788851414.969453:0:24765:0:(import.c:65:import_set_state_nolock()) ffff892d881ce800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851414.969569:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b140db83-9b09-493c-aeff-0cdb002e3e74+6:2406:x1875746000886016:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 473us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851414.969577:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00002000:00100000:1.0:1788851414.971056:0:24280:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b140db83-9b09-493c-aeff-0cdb002e3e74/ffff892eb67b1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788851414.971072:0:24280:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788851414.971148:0:24280:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788851414.971183:0:24280:0:(import.c:65:import_set_state_nolock()) ffff892eb67b2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851414.971240:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+6:2406:x1875746000886144:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 2115us (2457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851414.971249:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:3.0:1788851414.975270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851414.975624:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000886272 00000100:00100000:0.0:1788851414.975636:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000886272 00000100:00100000:0.0:1788851414.975697:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1788851414.975719:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8839b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b140db83-9b09-493c-aeff-0cdb002e3e74+6:18219:x1875746000886272:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788851414.975802:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8839b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b140db83-9b09-493c-aeff-0cdb002e3e74+6:18219:x1875746000886272:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 86us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851414.975811:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:3.0:1788851414.979225:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851414.979495:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000886400 00000100:00100000:2.0:1788851414.979508:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000886400 00000100:00100000:2.0:1788851414.979561:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:2.0:1788851414.979570:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+6:18219:x1875746000886400:12345-192.168.204.27@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788851414.979754:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788851414.979958:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+6:18219:x1875746000886400:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 388us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851414.979966:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00010000:00010000:2.0:1788851415.157855:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851415.158361:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851415.158460:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000886528 00000100:00100000:1.0:1788851415.158471:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000886528 00000100:00100000:1.0:1788851415.158574:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:1.0:1788851415.158585:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+6:18254:x1875746000886528:12345-192.168.204.27@tcp:101:mkdir.0 00010000:00010000:1.0:1788851415.158621:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851415.158643:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b207862 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c3909b expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851415.158723:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b207869 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851415.158748:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b207869 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851415.159139:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b207869 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851415.159185:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788851415.159190:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788851415.159210:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b207869 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851415.159239:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031200/0x3e0030720b207862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3909b expref: 8 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851415.159260:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b207869 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3909b expref: 7 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851415.159269:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e83031800) 00010000:00010000:1.0:1788851415.159272:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851415.159276:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80030800, rc 0) 00000100:00100000:1.0:1788851415.159349:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+7:18254:x1875746000886528:12345-192.168.204.27@tcp:101:mkdir.0 Request processed in 765us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851415.159357:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00010000:00010000:1.0:1788851416.181221:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851417.013350:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019871872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851417.013443:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851417.013659:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019871872 00000100:00100000:0.0:1788851417.013669:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019871872 00000100:00100000:0.0:1788851417.013756:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788851417.013766:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019871872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788851417.013800:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788851417.013972:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851417.014074:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019871872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 309us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851417.014083:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788851417.014168:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019871872:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788851417.204350:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851418.036227:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019872000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851418.036323:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.036413:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019872000 00000100:00100000:3.0:1788851418.036421:0:24282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019872000 00000100:00100000:3.0:1788851418.036471:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788851418.036479:0:24282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019872000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851418.036502:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788851418.036544:0:24282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875746019872000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851418.036551:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788851418.036570:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851418.036602:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019872000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851418.037709:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019872128:0@lo:400:kworker.0 00000100:00100000:1.0:1788851418.037765:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.037886:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019872256:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.037913:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.037956:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019872768:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.037977:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.037995:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019873280:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.038034:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.038050:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019873792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851418.038068:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.038102:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019872768 00000100:00100000:3.0:1788851418.038109:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019872768 00000100:00100000:3.0:1788851418.038152:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851418.038159:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019872768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.038206:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875746019872768:12345-0@lo:400:kworker.0 Request processed in 47us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851418.038213:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851418.038238:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019873280 00000100:00100000:3.0:1788851418.038242:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019873280 00000100:00100000:3.0:1788851418.038278:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788851418.038284:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019873280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.038313:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875746019873280:12345-0@lo:400:kworker.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851418.038319:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788851418.038336:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019872256 00000100:00100000:3.0:1788851418.038340:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019872256 00000100:00100000:3.0:1788851418.038359:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019873792 00000100:00100000:3.0:1788851418.038360:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019873792 00000100:00100000:3.0:1788851418.038399:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788851418.038405:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019872256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.038436:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019872256:12345-0@lo:400:kworker.0 Request processed in 31us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851418.038442:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788851418.038453:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788851418.038458:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019873792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788851418.038482:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788851418.038511:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019873792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851418.038958:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019872640:0@lo:400:kworker.0 00000100:00100000:1.0:1788851418.038984:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851418.038993:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019873152:0@lo:400:kworker.0 00000100:00100000:1.0:1788851418.039025:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851418.039042:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019873664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788851418.039066:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851418.039102:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019872128 00000100:00100000:1.0:1788851418.039106:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019872128 00000100:00100000:1.0:1788851418.039135:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788851418.039142:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:3649:x1875746019872128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851418.039179:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:3649:x1875746019872128:12345-0@lo:400:kworker.0 Request processed in 38us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851418.039186:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788851418.039220:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019873152 00000100:00100000:1.0:1788851418.039223:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019873152 00000100:00100000:1.0:1788851418.039247:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788851418.039253:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019873152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851418.039282:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019873152:12345-0@lo:400:kworker.0 Request processed in 29us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851418.039289:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788851418.039327:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019872128:0@lo:400:kworker.0 00000100:00100000:1.0:1788851418.039340:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019873152:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.039568:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788851418.039583:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019872640 00000100:00100000:3.0:1788851418.039586:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019872640 00000100:00100000:3.0:1788851418.039602:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788851418.039607:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019872640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.039661:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019872640:12345-0@lo:400:kworker.0 Request processed in 54us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851418.039667:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788851418.039717:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019872384:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.039741:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.039756:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019872896:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.040105:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.040127:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019873408:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.040150:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.040171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019873920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851418.040203:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.040220:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788851418.040226:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019872512:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.040243:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.040258:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019873024:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.040277:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.040287:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019873536:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.040307:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.040328:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019873408 00000100:00100000:3.0:1788851418.040332:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019873408 00000100:00100000:3.0:1788851418.040381:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019872512 00000100:00100000:3.0:1788851418.040385:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019872512 00000100:00100000:3.0:1788851418.040397:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019873024 00000100:00100000:3.0:1788851418.040400:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019873024 00000100:00100000:3.0:1788851418.040408:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019873536 00000100:00100000:3.0:1788851418.040411:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019873536 00000100:00100000:3.0:1788851418.040426:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788851418.040432:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019873408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.040469:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019873408:12345-0@lo:400:kworker.0 Request processed in 37us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851418.040474:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788851418.040487:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788851418.040493:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019872512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.040518:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019872512:12345-0@lo:400:kworker.0 Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851418.040524:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788851418.040534:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788851418.040546:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019873024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.040574:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019873024:12345-0@lo:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851418.040580:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788851418.040591:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788851418.040596:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019873536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.040618:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019873536:12345-0@lo:400:kworker.0 Request processed in 22us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851418.040623:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788851418.040653:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019872512:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.040662:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019873024:0@lo:400:kworker.0 00010000:00080000:3.0:1788851418.040671:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87b8df80 x1875746019873536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851418.040692:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019873536:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.040702:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019873408:0@lo:400:kworker.0 00000100:00080000:3.0:1788851418.040726:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851418.040731:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851418.040746:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019873664 00000100:00100000:3.0:1788851418.040749:0:24282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019873664 00000100:00100000:1.0:1788851418.042433:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019872384 00000100:00100000:1.0:1788851418.042447:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019872384 00000100:00100000:1.0:1788851418.042508:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019872896 00000100:00100000:1.0:1788851418.042512:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019872896 00000100:00100000:1.0:1788851418.042539:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851418.042549:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019872384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851418.042574:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019873920 00000100:00100000:2.0:1788851418.042580:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019873920 00000100:00100000:2.0:1788851418.042615:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788851418.042625:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019873920:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788851418.042639:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019872384:12345-0@lo:400:kworker.0 Request processed in 91us (2895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851418.042647:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00000024:2.0:1788851418.042654:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788851418.042666:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788851418.042687:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875746019872896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851418.042728:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875746019872896:12345-0@lo:400:kworker.0 Request processed in 53us (2622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851418.042735:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788851418.042740:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019873920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851418.042748:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788851418.042830:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019872640:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.043346:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788851418.043359:0:24282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019873664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788851418.043394:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788851418.043439:0:24282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019873664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (4372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851418.043456:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788851418.043479:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851418.043502:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788851418.043530:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019872384:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.043544:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019872896:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.043559:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019873920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851418.043599:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019872256:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.043611:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875746019872768:0@lo:400:kworker.0 00010000:00080000:3.0:1788851418.043624:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d87bd5500 x1875746019873280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851418.043635:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875746019873280:0@lo:400:kworker.0 00000100:00100000:3.0:1788851418.043648:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019873792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851418.043699:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019873664:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1788851418.044955:0:23503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b140db83-9b09-493c-aeff-0cdb002e3e74 00000001:00100000:2.0:1788851418.044968:0:23503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0844575f-19e7-4df3-8155-eb6a1666d628 00000001:00100000:3.0:1788851418.045214:0:22749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b140db83-9b09-493c-aeff-0cdb002e3e74 00000001:00100000:3.0:1788851418.045222:0:22749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0844575f-19e7-4df3-8155-eb6a1666d628 00000001:00100000:1.0:1788851418.045555:0:24275:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b140db83-9b09-493c-aeff-0cdb002e3e74 00000001:00100000:1.0:1788851418.045562:0:24275:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0844575f-19e7-4df3-8155-eb6a1666d628 00000100:00100000:1.0:1788851418.046161:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851418.046187:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019874048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851418.046263:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851418.046360:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019874048 00000100:00100000:3.0:1788851418.046383:0:24282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019874048 00000100:00100000:3.0:1788851418.046444:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788851418.046456:0:24282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019874048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851418.046482:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788851418.046538:0:24282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019874048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851418.046552:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788851418.046617:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019874048:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788851418.121372:0:25651:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788851418.236742:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851419.256135:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851420.277329:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851420.413870:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851420.413982:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851420.414043:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851420.414679:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000887040 00000100:00100000:0.0:1788851420.414695:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000887040 00000100:00080000:2.0:1788851420.414770:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851420.414805:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:0.0:1788851420.414822:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0844575f-19e7-4df3-8155-eb6a1666d628+5:2408:x1875746000887040:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851420.415563:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0844575f-19e7-4df3-8155-eb6a1666d628+5:2408:x1875746000887040:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 628us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851420.415637:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:1.0:1788851420.418813:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851420.418856:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851420.418896:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851420.420752:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000886784 00000100:00100000:3.0:1788851420.420773:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000886784 00000100:00100000:3.0:1788851420.421592:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000887552 00000100:00100000:3.0:1788851420.421602:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000887552 00000100:00100000:3.0:1788851420.421717:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1788851420.421730:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2408:x1875746000887552:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851420.422435:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2408:x1875746000887552:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 702us (3633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851420.422503:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:0.0:1788851420.422524:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000887296 00000100:00100000:0.0:1788851420.422534:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000887296 00000100:00080000:3.0:1788851420.422543:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851420.422550:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851420.422586:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000886912 00000100:00100000:0.0:1788851420.422591:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000886912 00000100:00080000:3.0:1788851420.422596:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851420.422601:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851420.422613:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1788851420.422625:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+6:2408:x1875746000887296:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851420.422645:0:22770:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788851420.422657:0:22770:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788851420.422683:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+6:2408:x1875746000887296:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 61us (8639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851420.422692:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1788851420.422715:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:0.0:1788851420.422724:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:2408:x1875746000886912:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851420.422728:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000886656 00000100:00100000:1.0:1788851420.422736:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000886656 00000100:00100000:0.0:1788851420.422766:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:2408:x1875746000886912:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 43us (3868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851420.422775:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:1.0:1788851420.422780:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:1.0:1788851420.422790:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ebbc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:2408:x1875746000886656:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1788851420.422796:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:0.0:1788851420.422806:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+6:2408:x1875746000886784:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851420.422822:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ebbc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:2408:x1875746000886656:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (3964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851420.422829:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:0.0:1788851420.422841:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+6:2408:x1875746000886784:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 37us (8986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851420.422849:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:1.0:1788851420.422944:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851420.422967:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851420.422984:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851420.423005:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000887168 00000100:00100000:1.0:1788851420.423009:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000887168 00000100:00100000:0.0:1788851420.423056:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000887680 00000100:00100000:0.0:1788851420.423063:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000887680 00000100:00100000:1.0:1788851420.423080:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:1.0:1788851420.423089:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0844575f-19e7-4df3-8155-eb6a1666d628+5:2408:x1875746000887168:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851420.423118:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0844575f-19e7-4df3-8155-eb6a1666d628+5:2408:x1875746000887168:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 30us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851420.423124:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00080000:1.0:1788851420.423142:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851420.423149:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000887424 00000100:00100000:3.0:1788851420.423156:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000887424 00000100:00100000:1.0:1788851420.423163:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:1.0:1788851420.423173:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b140db83-9b09-493c-aeff-0cdb002e3e74+6:2408:x1875746000887680:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851420.423199:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b140db83-9b09-493c-aeff-0cdb002e3e74+6:2408:x1875746000887680:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851420.423201:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:1.0:1788851420.423211:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1788851420.423216:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2408:x1875746000887424:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:1.0:1788851420.423235:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851420.423252:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2408:x1875746000887424:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 39us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851420.423260:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000040:00080000:0.0:1788851420.725163:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1788851421.134909:0:25093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b140db83-9b09-493c-aeff-0cdb002e3e74 00010000:00010000:2.0:1788851421.302210:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851422.135468:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019874176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851422.135700:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851422.135855:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019874176 00000100:00100000:2.0:1788851422.135867:0:24282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019874176 00000100:00100000:2.0:1788851422.135975:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788851422.135986:0:24282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019874176:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788851422.136077:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788851422.136142:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788851422.136204:0:24282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019874176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 220us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851422.136213:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788851422.136300:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019874176:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788851422.345295:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788851422.652289:0:25800:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc775fead0 20000000:00000080:2.0:1788851422.652316:0:25800:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff892ea7c94000 uarg=0000000000000000 20000000:01000000:2.0:1788851422.652386:0:25800:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788851422.652394:0:25800:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788851422.652400:0:25800:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788851422.652915:0:25801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788851422.653322:0:25800:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788851422.664406:0:25800:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788851422.664457:0:25800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.664483:0:25800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e827eb800/0x3e0030720b2074cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2074c6 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.665288:0:25800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e827ea000/0x3e0030720b2074db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2074d4 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.665308:0:25800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebbdaac00/0x3e0030720b20751a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207513 expref: 23 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.665315:0:25800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ebff94a00/0x3e0030720b2075b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2075ad expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.665327:0:25800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892ec2154800/0x3e0030720b207800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ffa expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.665335:0:25800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff892e80030400/0x3e0030720b20783f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3906a expref: 12 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.665344:0:25800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.665428:0:25800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e80030400/0x3e0030720b20783f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3906a expref: 12 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.665448:0:25800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e80030400/0x3e0030720b20783f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3906a expref: 12 pid: 22763 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851422.665468:0:25800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1875746019874304:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851422.665667:0:25800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ec2154800/0x3e0030720b207800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ffa expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.665676:0:25800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ec2154800/0x3e0030720b207800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ffa expref: 12 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851422.665693:0:25800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1875746019874432:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851422.665731:0:25800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebff94a00/0x3e0030720b2075b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2075ad expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.665740:0:25800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ebff94a00/0x3e0030720b2075b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2075ad expref: 23 pid: 22764 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851422.665748:0:25800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e8707a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1875746019874560:0@lo:104: 00000100:00100000:2.0:1788851422.665801:0:25800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788851422.668766:0:25800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892ebbdaac00/0x3e0030720b20751a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b207513 expref: 23 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.668791:0:25800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892ebbdaac00/0x3e0030720b20751a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b207513 expref: 23 pid: 22763 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851422.668811:0:25800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1875746019874688:0@lo:104: 00000100:00100000:1.0:1788851422.669984:0:25800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788851422.672219:0:25800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e827ea000/0x3e0030720b2074db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2074d4 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.672242:0:25800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e827ea000/0x3e0030720b2074db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2074d4 expref: 23 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851422.672260:0:25800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1875746019874816:0@lo:104: 00000100:00100000:1.0:1788851422.672314:0:25800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788851422.672339:0:25800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff892e827eb800/0x3e0030720b2074cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e0030720b2074c6 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.672348:0:25800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff892e827eb800/0x3e0030720b2074cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e0030720b2074c6 expref: 23 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851422.672356:0:25800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1875746019874944:0@lo:104: 00000100:00100000:1.0:1788851422.672377:0:25800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851422.672389:0:25800:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2186c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851422.672425:0:25800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1875746019874304:192.168.204.27@tcp:104: 00000100:00100000:3.0:1788851422.672604:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019874560 00000100:00100000:3.0:1788851422.672615:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019874560 00000100:00100000:3.0:1788851422.672706:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019874688 00000100:00100000:3.0:1788851422.672710:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019874688 00000100:00100000:3.0:1788851422.672725:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019874816 00000100:00100000:3.0:1788851422.672727:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019874816 00000100:00100000:3.0:1788851422.672736:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019874944 00000100:00100000:3.0:1788851422.672738:0:22753:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019874944 00000100:00100000:3.0:1788851422.672752:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788851422.672763:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+6:25800:x1875746019874560:12345-0@lo:104: 00010000:00010000:3.0:1788851422.672779:0:22753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2075b4 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851422.673348:0:25800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1875746019874432:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851422.673361:0:25800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e8707a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1875746019874560:0@lo:104: 00010000:00010000:3.0:1788851422.673806:0:22753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788851422.673816:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+6:25800:x1875746019874560:12345-0@lo:104: Request processed in 1054us (8015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851422.673826:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788851422.673929:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788851422.673942:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+5:25800:x1875746019874688:12345-0@lo:104: 00010000:00010000:3.0:1788851422.673954:0:22753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20751a expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.674169:0:22753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788851422.674176:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+5:25800:x1875746019874688:12345-0@lo:104: Request processed in 239us (4197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851422.674199:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788851422.674214:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788851422.674220:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+4:25800:x1875746019874816:12345-0@lo:104: 00010000:00010000:3.0:1788851422.674230:0:22753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2074db expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.674270:0:22753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788851422.674276:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+4:25800:x1875746019874816:12345-0@lo:104: Request processed in 57us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851422.674281:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788851422.674294:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788851422.674301:0:22753:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+3:25800:x1875746019874944:12345-0@lo:104: 00010000:00010000:3.0:1788851422.674309:0:22753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2074cd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.674336:0:22753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788851422.674340:0:22753:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+3:25800:x1875746019874944:12345-0@lo:104: Request processed in 41us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851422.674344:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788851422.674362:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788851422.674370:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2075b4 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851422.674472:0:25800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1875746019874688:0@lo:104: 00000100:00100000:1.0:1788851422.674635:0:25800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1875746019874816:0@lo:104: 00000100:00100000:1.0:1788851422.674644:0:25800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25800:1875746019874944:0@lo:104: 00010000:00010000:1.0:1788851422.674691:0:25800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.674721:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788851422.674726:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b20751a expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.674734:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdaa400 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851422.674739:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b20751a expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.674758:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b20751a expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851422.674765:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b20751a expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851422.674772:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851422.674828:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20751a expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.674835:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788851422.674947:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3650:1875746019875072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851422.675175:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdabc00 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851422.675179:0:25110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2075b4 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.675199:0:25110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2075b4 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851422.675206:0:25110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2075b4 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851422.675212:0:25110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788851422.675243:0:25110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2075b4 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.675249:0:25110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851422.675268:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2075b4 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.675276:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebbdabc00/0x3e0030720b2075ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2075b4 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.675292:0:25110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788851422.675295:0:25110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2074db expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.675301:0:25110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e827ea600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:3.0:1788851422.675305:0:25110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2074db expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.675312:0:25110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2074db expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851422.675318:0:25110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2074db expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851422.675331:0:25110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788851422.675346:0:25110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2074db expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.675352:0:25110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851422.675359:0:25110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2074db expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.675366:0:25110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892e827ea600/0x3e0030720b2074d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2074db expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851422.675461:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788851422.675469:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20751a expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.675477:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa400/0x3e0030720b207513 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b20751a expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.675489:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851422.675492:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e0030720b2074cd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.675497:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdaa600 already unused, calling callback (ffffffffc1446c20) 10000000:00010000:1.0:1788851422.675500:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e0030720b2074cd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.675507:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e0030720b2074cd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851422.675514:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e0030720b2074cd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851422.675619:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019875072 00000100:00100000:2.0:1788851422.675628:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019875072 00010000:00010000:0.0:1788851422.675653:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851422.675664:0:22755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebbdaac00/0x3e0030720b20751a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207513 expref: 24 pid: 22763 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851422.675696:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851422.675700:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3648:1875746019875328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851422.675703:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:3650:x1875746019875072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851422.675728:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788851422.675730:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788851422.675734:0:22755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebbdaac00/0x3e0030720b20751a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b207513 expref: 24 pid: 22763 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.675747:0:22755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebbdaac00/0x3e0030720b20751a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b207513 expref: 24 pid: 22763 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851422.675748:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851422.675753:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3648:1875746019875200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851422.675764:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebbdaac00/0x3e0030720b20751a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b207513 expref: 24 pid: 22763 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851422.675770:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788851422.675779:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851422.675792:0:22754:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788851422.675802:0:22754:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788851422.675813:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:3650:x1875746019875072:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851422.675820:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788851422.675838:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019875328 00000100:00100000:2.0:1788851422.675841:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019875328 00010000:00010000:2.0:1788851422.675851:0:22755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e827ea000/0x3e0030720b2074db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2074d4 expref: 23 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851422.675946:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851422.675963:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2074cd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.675969:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851422.675980:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2074cd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.675986:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff892ebbdaa600/0x3e0030720b2074c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e0030720b2074cd expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.676000:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851422.676002:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851422.676004:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851422.676057:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019875456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851422.676071:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019875200 00000100:00100000:0.0:1788851422.676075:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019875200 00000100:00100000:1.0:1788851422.676085:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788851422.676089:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ebff94a00/0x3e0030720b2075b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2075ad expref: 24 pid: 22764 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851422.676103:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019875456 00000100:00100000:0.0:1788851422.676106:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019875456 00010000:00010000:0.0:1788851422.676117:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e827eb800/0x3e0030720b2074cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2074c6 expref: 25 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851422.676129:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788851422.676135:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+25:3648:x1875746019875200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851422.676142:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851422.676145:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ebff94a00/0x3e0030720b2075b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2075ad expref: 25 pid: 22764 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851422.676153:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ebff94a00/0x3e0030720b2075b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2075ad expref: 25 pid: 22764 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851422.676216:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788851422.676223:0:25802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc4a524f-5762-4d21-be7e-dbb6f41ca491+25:3649:x1875746019875456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851422.676231:0:25802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851422.676236:0:25802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e827eb800/0x3e0030720b2074cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2074c6 expref: 25 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851422.676632:0:22755:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1788851422.676640:0:22755:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1788851422.676657:0:22756:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1788851422.676666:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851422.676673:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+25:3648:x1875746019875328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851422.676833:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851422.676836:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851422.676838:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851422.677169:0:25802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e827eb800/0x3e0030720b2074cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2074c6 expref: 25 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.677187:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827eb800/0x3e0030720b2074cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2074c6 expref: 25 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.677213:0:25802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851422.677278:0:25802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:3649:x1875746019875456:12345-0@lo:103:ldlm_bl.0 Request processed in 1055us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851422.677286:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788851422.677298:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ebff94a00/0x3e0030720b2075b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2075ad expref: 24 pid: 22764 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851422.677319:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851422.677333:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3649:1875746019875456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851422.677349:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:3648:x1875746019875200:12345-0@lo:103:ldlm_bl.0 Request processed in 1214us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851422.677355:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788851422.677398:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3648:1875746019875200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851422.677431:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3650:1875746019875072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851422.677557:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851422.677565:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e827ea000/0x3e0030720b2074db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e0030720b2074d4 expref: 21 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.677575:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e827ea000/0x3e0030720b2074db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e0030720b2074d4 expref: 21 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.677607:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e827ea000/0x3e0030720b2074db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e0030720b2074d4 expref: 21 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851422.677617:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851422.677657:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:3648:x1875746019875328:12345-0@lo:103:ldlm_bl.0 Request processed in 985us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851422.677664:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788851422.677915:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851422.677966:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851422.678004:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3648:1875746019875328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851422.678028:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000887936 00000100:00100000:3.0:1788851422.678036:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000887936 00010000:00010000:3.0:1788851422.678067:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892ec2154800/0x3e0030720b207800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ffa expref: 13 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851422.678081:0:25802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000887808 00000100:00100000:0.0:1788851422.678085:0:25802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000887808 00000100:00100000:3.0:1788851422.678095:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00010000:00010000:0.0:1788851422.678114:0:25802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff892e80030400/0x3e0030720b20783f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3906a expref: 14 pid: 22763 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851422.678134:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:0.0:1788851422.678141:0:25802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+14:2407:x1875746000887808:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851422.678152:0:25802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851422.678156:0:25802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892e80030400/0x3e0030720b20783f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3906a expref: 14 pid: 22763 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851422.678307:0:25802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892e80030400/0x3e0030720b20783f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3906a expref: 14 pid: 22763 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851422.678321:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892e80030400/0x3e0030720b20783f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3906a expref: 14 pid: 22763 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851422.678333:0:25802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851422.678378:0:25802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:2407:x1875746000887808:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 238us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851422.678386:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:3.0:1788851422.678942:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+12:2407:x1875746000887936:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851422.678968:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851422.678975:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff892ec2154800/0x3e0030720b207800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ffa expref: 12 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.678987:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff892ec2154800/0x3e0030720b207800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ffa expref: 12 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.678998:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ec2154800/0x3e0030720b207800 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c38ffa expref: 12 pid: 22761 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.679048:0:22754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.679058:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.679078:0:22754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.679085:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.679092:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.679099:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.679119:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ec2154c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:3.0:1788851422.679123:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.679132:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.679148:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851422.679159:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851422.679195:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:2407:x1875746000887936:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 1091us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851422.679209:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00010000:00010000:1.0:1788851422.679416:0:25800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.679427:0:25800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851422.679434:0:25800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff892ec2154c00/0x3e0030720b207870 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851423.156596:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019875584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788851423.156700:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.156764:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019875584 00000100:00100000:3.0:1788851423.156777:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019875584 00000100:00100000:0.0:1788851423.156783:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851423.156793:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019875840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851423.156830:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.156840:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788851423.156853:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019875584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788851423.156900:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788851423.156965:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019875584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851423.156972:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788851423.157075:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019875584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788851423.158486:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019875968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851423.158573:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851423.158593:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851423.158615:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019876352:0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.158640:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019876480:0@lo:400:kworker.0 00000100:00100000:0.0:1788851423.158673:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.158692:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851423.158703:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3648:1875746019876224:0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.158719:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788851423.158729:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019875712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851423.158749:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851423.158765:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019875840 00000100:00100000:1.0:1788851423.158781:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019875840 00000100:00100000:1.0:1788851423.158845:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019875968 00000100:00100000:1.0:1788851423.158849:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019875968 00000100:00100000:1.0:1788851423.158870:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788851423.158880:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019875840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851423.158918:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788851423.159047:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019876224 00000100:00100000:2.0:1788851423.159052:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019876224 00000100:00100000:2.0:1788851423.159087:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788851423.159095:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e89049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:3648:x1875746019876224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851423.159871:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019876864:0@lo:400:kworker.0 00000100:00100000:2.0:1788851423.160481:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e89049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:3648:x1875746019876224:12345-0@lo:400:kworker.0 Request processed in 1384us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851423.160494:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788851423.160555:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019876736:0@lo:400:kworker.0 00000100:00100000:2.0:1788851423.160608:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851423.160641:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019877248:0@lo:400:kworker.0 00000100:00100000:2.0:1788851423.160668:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.160677:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851423.160714:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019877248 00000100:00100000:3.0:1788851423.160716:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb694c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019876096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851423.160721:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019877248 00000100:00100000:3.0:1788851423.160751:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.160772:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019876608:0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.160793:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.160822:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019876992:0@lo:400:kworker.0 00000100:00100000:2.0:1788851423.160826:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019876608 00000100:00100000:2.0:1788851423.160832:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019876608 00000100:00100000:3.0:1788851423.160846:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851423.160907:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019875840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2028us (4076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851423.160915:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788851423.160930:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019875712 00000100:00100000:1.0:1788851423.160933:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019875712 00000100:00100000:1.0:1788851423.160949:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788851423.160956:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019875968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851423.160983:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788851423.161040:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019875968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (2470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851423.161046:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788851423.161059:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788851423.161066:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019875712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788851423.161076:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788851423.161100:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019875712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851423.161106:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788851423.161126:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019876480 00000100:00100000:1.0:1788851423.161130:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019876480 00000100:00100000:1.0:1788851423.161154:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019876736 00000100:00100000:1.0:1788851423.161157:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019876736 00000100:00100000:1.0:1788851423.161175:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788851423.161181:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019876480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851423.161213:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019876480:12345-0@lo:400:kworker.0 Request processed in 32us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851423.161235:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788851423.161248:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788851423.161253:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019876736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851423.161282:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019876736:12345-0@lo:400:kworker.0 Request processed in 29us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851423.161288:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788851423.161306:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851423.161311:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851423.161313:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851423.161541:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851423.161601:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019877376:0@lo:400:kworker.0 00000100:00100000:0.0:1788851423.161668:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019876864 00000100:00100000:0.0:1788851423.161675:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019876864 00000100:00100000:0.0:1788851423.161717:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788851423.161726:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019876864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851423.161781:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019876864:12345-0@lo:400:kworker.0 Request processed in 56us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851423.161788:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788851423.161889:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019876352 00000100:00100000:0.0:1788851423.161894:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019876352 00000100:00100000:0.0:1788851423.161922:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019876096 00000100:00100000:0.0:1788851423.161926:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019876096 00000100:00100000:0.0:1788851423.161940:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788851423.161945:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019876352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851423.162045:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875746019876352:12345-0@lo:400:kworker.0 Request processed in 65us (3343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851423.162061:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788851423.162076:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788851423.162082:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019876096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788851423.162111:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788851423.162148:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019876096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851423.162155:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788851423.162178:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019877120:0@lo:400:kworker.0 00000100:00100000:2.0:1788851423.163180:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019876992 00000100:00100000:2.0:1788851423.163192:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019876992 00000100:00100000:3.0:1788851423.163219:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019877504:0@lo:400:kworker.0 00000100:00100000:2.0:1788851423.163245:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788851423.163257:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019877248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.163275:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851423.163325:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875746019877248:12345-0@lo:400:kworker.0 Request processed in 70us (2655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851423.163340:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019875712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788851423.163343:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788851423.163368:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019877504 00000100:00100000:3.0:1788851423.163370:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019876096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788851423.163386:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019876480:0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.163399:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019875968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851423.163448:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.163477:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.163497:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875746019876352:0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.163508:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb694f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3648:1875746019876224:0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.163528:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019876864:0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.163568:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019876736:0@lo:400:kworker.0 00000100:00100000:1.0:1788851423.163687:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019877120 00010000:00080000:3.0:1788851423.163691:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e15500 x1875746019877248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851423.163694:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019877120 00000100:00100000:3.0:1788851423.163706:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875746019877248:0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.163728:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019875840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851423.163732:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019877376 00000100:00100000:1.0:1788851423.163737:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019877376 00000100:00100000:1.0:1788851423.163759:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788851423.163767:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019876608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.163776:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788851423.163786:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019876992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851423.163820:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875746019876608:12345-0@lo:400:kworker.0 Request processed in 54us (3025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851423.163828:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788851423.163833:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875746019876992:12345-0@lo:400:kworker.0 Request processed in 47us (2985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851423.163839:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788851423.163852:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788851423.163858:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019877120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.163895:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875746019877120:12345-0@lo:400:kworker.0 Request processed in 37us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851423.163901:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788851423.163915:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788851423.163920:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019877376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851423.163920:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019877504 00000100:00100000:2.0:1788851423.163957:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788851423.163962:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875746019877376:12345-0@lo:400:kworker.0 Request processed in 41us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851423.163967:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019877504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.163974:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788851423.164008:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875746019877120:0@lo:400:kworker.0 00000100:00100000:2.0:1788851423.164035:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875746019877504:12345-0@lo:400:kworker.0 Request processed in 47us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851423.164046:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788851423.164066:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875746019877376:0@lo:400:kworker.0 00000100:00080000:0.0:1788851423.164131:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788851423.164142:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851423.164152:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875746019876992:0@lo:400:kworker.0 00010000:00080000:3.0:1788851423.164167:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892e83e14700 x1875746019877504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851423.164178:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875746019877504:0@lo:400:kworker.0 00000100:00100000:3.0:1788851423.164192:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875746019876608:0@lo:400:kworker.0 00010000:00010000:0.0:1788851423.348787:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788851423.860246:0:22766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788851423.860257:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892d881cb800 from 13 10000000:01000000:1.0:1788851423.860263:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788851423.860322:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030e00/0x3e0030720b207877 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851423.860336:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80030e00/0x3e0030720b207877 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851423.860347:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80030e00/0x3e0030720b207877 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851423.860392:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019877632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788851423.860474:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851423.860539:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e81690cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851423.860557:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019877632 00000100:00100000:2.0:1788851423.860578:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019877632 00000100:00100000:2.0:1788851423.860646:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788851423.860656:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8904b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+20:22766:x1875746019877632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851423.860671:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851423.860687:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ec2154e00/0x3e0030720b20787e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207877 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851423.860715:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2154e00/0x3e0030720b20787e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207877 expref: 21 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851423.860726:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ec2154e00/0x3e0030720b20787e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207877 expref: 21 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851423.860736:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2154e00, rc 0) 00000100:00100000:2.0:1788851423.860791:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8904b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:22766:x1875746019877632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851423.860799:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788851423.861043:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019877632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851423.861058:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80030e00/0x3e0030720b207877 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20787e expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851423.861067:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80030e00/0x3e0030720b207877 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20787e expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851423.861128:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019877760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851423.861156:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851423.861186:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e81690cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851423.861308:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019877760 00000100:00100000:2.0:1788851423.861392:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019877760 00000100:00100000:1.0:1788851423.861660:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788851423.861669:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e89048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:22766:x1875746019877760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851423.861802:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e89048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:22766:x1875746019877760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851423.861810:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788851423.861916:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019877760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851423.861949:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019877888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851423.861992:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.862050:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788851423.862163:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019877888 00000100:00100000:0.0:1788851423.862168:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019877888 00000100:00100000:0.0:1788851423.862204:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788851423.862211:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e89048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:22766:x1875746019877888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851423.862309:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e89048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:22766:x1875746019877888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851423.862325:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788851423.862653:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019877888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788851423.865641:0:25815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788851423.868302:0:22766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788851423.868819:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788851423.868831:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80030e00/0x3e0030720b207877 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20787e expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851423.868855:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80030e00/0x3e0030720b207877 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20787e expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851423.869248:0:22766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788851423.869252:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892e983ab800 from 13 10000000:01000000:3.0:1788851423.869255:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788851423.869298:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e6a00/0x3e0030720b207885 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851423.869306:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892d876e6a00/0x3e0030720b207885 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851423.869388:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892d876e6a00/0x3e0030720b207885 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851423.869414:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788851423.869486:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.869591:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788851423.869769:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019878016 00000100:00100000:0.0:1788851423.869778:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019878016 00000100:00100000:0.0:1788851423.869829:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788851423.869837:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e89049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+21:22766:x1875746019878016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851423.869861:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851423.869880:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eeba800/0x3e0030720b20788c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207885 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851423.869920:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eeba800/0x3e0030720b20788c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207885 expref: 22 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851423.869932:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eeba800/0x3e0030720b20788c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207885 expref: 22 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851423.869941:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eeba800, rc 0) 00000100:00100000:0.0:1788851423.869996:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e89049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:22766:x1875746019878016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851423.870003:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788851423.870229:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851423.870243:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892d876e6a00/0x3e0030720b207885 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20788c expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851423.870252:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892d876e6a00/0x3e0030720b207885 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20788c expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851423.870307:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851423.870352:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.870379:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788851423.870481:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019878144 00000100:00100000:2.0:1788851423.870486:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019878144 00000100:00100000:2.0:1788851423.870529:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788851423.870537:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8904ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:22766:x1875746019878144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851423.870664:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8904ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:22766:x1875746019878144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851423.870671:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788851423.870848:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851423.870888:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851423.870930:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.870950:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788851423.871054:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019878272 00000100:00100000:2.0:1788851423.871058:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019878272 00000100:00100000:2.0:1788851423.871087:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788851423.871094:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:22766:x1875746019878272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851423.871184:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:22766:x1875746019878272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851423.871198:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788851423.871764:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788851423.872964:0:25816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788851423.873428:0:22766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788851423.873450:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851423.873461:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892d876e6a00/0x3e0030720b207885 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20788c expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851423.873475:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892d876e6a00/0x3e0030720b207885 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20788c expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851423.873583:0:22766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788851423.873586:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892eb6cf0800 from 13 10000000:01000000:1.0:1788851423.873589:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788851423.873627:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b207893 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851423.873636:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b207893 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851423.873647:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b207893 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851423.873670:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788851423.873733:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851423.873777:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e81690cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851423.873860:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019878400 00000100:00100000:2.0:1788851423.873875:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019878400 00000100:00100000:2.0:1788851423.873922:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788851423.873931:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+22:22766:x1875746019878400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851423.873944:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851423.873957:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ec2154c00/0x3e0030720b20789a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b207893 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851423.873982:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2154c00/0x3e0030720b20789a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b207893 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851423.873993:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ec2154c00/0x3e0030720b20789a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b207893 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851423.874248:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2154c00, rc 0) 00000100:00100000:2.0:1788851423.874296:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:22766:x1875746019878400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 366us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851423.874303:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788851423.874439:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851423.874454:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b207893 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20789a expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851423.874464:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b207893 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b20789a expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851423.874637:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851423.874672:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.874699:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788851423.874736:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019878528 00000100:00100000:0.0:1788851423.874746:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019878528 00000100:00100000:0.0:1788851423.874768:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788851423.874775:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:22766:x1875746019878528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851423.874910:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:22766:x1875746019878528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851423.874917:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788851423.875053:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851423.875077:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851423.875128:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.875141:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788851423.875272:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019878656 00000100:00100000:2.0:1788851423.875277:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019878656 00000100:00100000:2.0:1788851423.875295:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788851423.875304:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:22766:x1875746019878656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851423.875689:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:22766:x1875746019878656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 387us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851423.875696:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788851423.875811:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788851423.877704:0:25817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788851423.878624:0:22766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788851423.878652:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851423.878663:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b207893 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20789a expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851423.878676:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80031800/0x3e0030720b207893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b20789a expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851423.878688:0:22766:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788851423.878690:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff892d89078800 from 13 10000000:01000000:1.0:1788851423.878693:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788851423.878734:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b2078a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851423.878756:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b2078a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851423.878766:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b2078a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851423.878793:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788851423.878878:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851423.878929:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e81690cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851423.879004:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019878784 00000100:00100000:0.0:1788851423.879057:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019878784 00000100:00100000:0.0:1788851423.879113:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788851423.879122:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+23:22766:x1875746019878784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851423.879135:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851423.879148:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892e9eebb200/0x3e0030720b2078a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e0030720b2078a1 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851423.879172:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892e9eebb200/0x3e0030720b2078a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e0030720b2078a1 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851423.879190:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892e9eebb200/0x3e0030720b2078a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e0030720b2078a1 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851423.879198:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebb200, rc 0) 00000100:00100000:0.0:1788851423.879240:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:22766:x1875746019878784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851423.879247:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788851423.879764:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851423.879781:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b2078a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2078a8 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851423.879789:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b2078a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e0030720b2078a8 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851423.879851:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851423.879884:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.879914:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851423.879963:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019878912 00000100:00100000:1.0:1788851423.879968:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019878912 00000100:00100000:1.0:1788851423.880033:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788851423.880042:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:22766:x1875746019878912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851423.880148:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:22766:x1875746019878912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851423.880155:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788851423.880270:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019878912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851423.880296:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019879040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851423.880351:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851423.880372:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851423.880472:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019879040 00000100:00100000:1.0:1788851423.880476:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019879040 00000100:00100000:1.0:1788851423.880517:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788851423.880523:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:22766:x1875746019879040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851423.880615:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:22766:x1875746019879040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851423.880622:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788851423.880759:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5ad4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc4a524f-5762-4d21-be7e-dbb6f41ca491:22766:1875746019879040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788851423.881811:0:25818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788851423.882182:0:22766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788851423.882204:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788851423.882213:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b2078a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2078a8 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851423.882225:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff892e80031200/0x3e0030720b2078a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e0030720b2078a8 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851423.924734:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788851424.117123:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851424.119638:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000888064 00000100:00100000:2.0:1788851424.119654:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000888064 00000100:00100000:2.0:1788851424.119733:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 159 00000100:00100000:2.0:1788851424.119744:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+11:18103:x1875746000888064:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851424.119763:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851424.119780:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892ec2154800/0x3e0030720b2078af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390a2 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851424.119811:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892ec2154800/0x3e0030720b2078af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390a2 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851424.119822:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892ec2154800/0x3e0030720b2078af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390a2 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851424.119864:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2154800, rc 0) 00000100:00100000:2.0:1788851424.120270:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+12:18103:x1875746000888064:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 527us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851424.120278:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 159 00000100:00100000:2.0:1788851424.125873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851424.125997:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000888192 00000100:00100000:0.0:1788851424.126009:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000888192 00000100:00100000:0.0:1788851424.126121:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:0.0:1788851424.126132:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+12:18103:x1875746000888192:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851424.126300:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+12:18103:x1875746000888192:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 170us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851424.126309:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:1.0:1788851424.134368:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851424.134735:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000888320 00000100:00100000:2.0:1788851424.134750:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000888320 00000100:00100000:2.0:1788851424.134825:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:2.0:1788851424.134837:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+12:18103:x1875746000888320:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851424.135294:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+12:18103:x1875746000888320:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 457us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851424.135303:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:2.0:1788851424.148537:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851424.163031:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000888448 00000100:00100000:3.0:1788851424.163052:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000888448 00000100:00100000:3.0:1788851424.163258:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:3.0:1788851424.163285:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+12:18103:x1875746000888448:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851424.163303:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851424.163322:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff892d876e7800/0x3e0030720b2078b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390a9 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.163355:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff892d876e7800/0x3e0030720b2078b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390a9 expref: 13 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.163366:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff892d876e7800/0x3e0030720b2078b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390a9 expref: 13 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.163374:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7800, rc 0) 00000100:00100000:3.0:1788851424.163533:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18103:x1875746000888448:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 250us (15007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851424.163541:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:2.0:1788851424.177165:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851424.177291:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000888576 00000100:00100000:0.0:1788851424.177300:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000888576 00000100:00100000:0.0:1788851424.177351:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 163 00000100:00100000:0.0:1788851424.177361:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18103:x1875746000888576:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851424.177499:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18103:x1875746000888576:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 139us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851424.177506:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 163 00000100:00100000:1.0:1788851424.183780:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851424.183945:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000888704 00000100:00100000:2.0:1788851424.183958:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000888704 00000100:00100000:2.0:1788851424.184057:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 164 00000100:00100000:2.0:1788851424.184067:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18103:x1875746000888704:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851424.184248:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:18103:x1875746000888704:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 181us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851424.184258:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 164 00010000:00010000:1.0:1788851424.374999:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851424.834945:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851424.835063:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000888832 00000100:00100000:3.0:1788851424.835074:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000888832 00000100:00100000:3.0:1788851424.835170:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:3.0:1788851424.835194:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+6:18724:x1875746000888832:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851424.835216:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851424.835239:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2078bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390b0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835313:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2078c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835329:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2078c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835362:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2078c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835379:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b2078cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835386:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b2078cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835392:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b2078cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835484:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2078d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835492:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2078d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835500:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2078d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851424.835534:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788851424.835538:0:22770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851424.835591:0:22770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2078d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835604:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2078c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835611:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2078c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835628:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2078c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835635:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851424.835639:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2078c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835647:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2078c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835659:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e83031800) 00010000:00010000:3.0:1788851424.835662:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851424.835668:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2078c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835676:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b2078c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835841:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b2078cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835849:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b2078cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835855:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b2078cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835860:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851424.835863:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b2078cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835879:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b2078cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835889:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff892ea5408900) 00010000:00010000:3.0:1788851424.835891:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851424.835894:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b2078cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835900:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b2078cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835933:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b2078bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390b0 expref: 8 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835948:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6e00/0x3e0030720b2078d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390b0 expref: 7 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.835954:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff892ea5408400) 00010000:00010000:3.0:1788851424.835956:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851424.835959:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6e00, rc 0) 00000100:00100000:3.0:1788851424.836078:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+7:18724:x1875746000888832:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 888us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851424.836086:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00080000:0.0:1788851424.836556:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851424.841357:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851424.841558:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000888960 00000100:00100000:1.0:1788851424.841569:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000888960 00000100:00100000:1.0:1788851424.841634:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:1.0:1788851424.841645:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0844575f-19e7-4df3-8155-eb6a1666d628+7:18724:x1875746000888960:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788851424.841738:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0844575f-19e7-4df3-8155-eb6a1666d628+7:18724:x1875746000888960:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 Request processed in 94us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851424.841745:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:2.0:1788851424.852934:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851424.853085:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000889216 00000100:00100000:1.0:1788851424.853096:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000889216 00000100:00100000:1.0:1788851424.853833:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:1.0:1788851424.853846:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+7:18724:x1875746000889216:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851424.853868:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851424.853888:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2078d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390b7 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.853965:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b2078e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.853979:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b2078e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.853990:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b2078e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854083:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2078e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854091:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2078e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854111:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2078e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854218:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031a00/0x3e0030720b2078ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854227:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031a00/0x3e0030720b2078ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854234:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031a00/0x3e0030720b2078ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851424.854243:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788851424.854389:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b2078e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854396:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b2078e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854402:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b2078e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854409:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851424.854413:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b2078e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854420:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b2078e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854433:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff892ea5408400) 00010000:00010000:1.0:1788851424.854436:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851424.854447:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b2078e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854454:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b2078e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854468:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2078e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854474:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2078e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854480:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2078e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854485:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851424.854488:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2078e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854494:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2078e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854501:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff892e83031200) 00010000:00010000:1.0:1788851424.854503:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851424.854505:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2078e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.854511:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b2078e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.856229:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b2078d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390b7 expref: 10 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.856268:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031a00/0x3e0030720b2078ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390b7 expref: 9 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.856276:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892e83031300) 00010000:00010000:1.0:1788851424.856279:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851424.856282:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031a00, rc 0) 00000100:00100000:1.0:1788851424.856370:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+9:18724:x1875746000889216:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 2526us (3444us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788851424.856378:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1788851424.867991:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851424.868165:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000889344 00000100:00100000:3.0:1788851424.868175:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000889344 00000100:00100000:3.0:1788851424.868236:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:3.0:1788851424.868246:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+9:18724:x1875746000889344:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788851424.868369:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+9:18724:x1875746000889344:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 124us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851424.868376:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1788851424.873125:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851424.873263:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000889472 00000100:00100000:2.0:1788851424.873272:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000889472 00000100:00100000:2.0:1788851424.873346:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:2.0:1788851424.873356:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:18724:x1875746000889472:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788851424.873865:0:22771:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 471us 00000100:00080000:0.0:1788851424.876162:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788851424.888722:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851424.888794:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000889600 00000100:00100000:0.0:1788851424.888810:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000889600 00000100:00100000:0.0:1788851424.888873:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:0.0:1788851424.888884:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+9:18730:x1875746000889600:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851424.888906:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851424.888928:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b2078fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390be expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889638:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b207903 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889654:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b207903 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889667:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b207903 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889779:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20790a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889787:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20790a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889794:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20790a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889837:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b207903 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889844:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b207903 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889852:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b207903 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889867:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebbc00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851424.889871:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b207903 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889879:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b207903 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889891:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e83031800) 00010000:00010000:0.0:1788851424.889893:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851424.889898:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b207903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889905:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b207903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889918:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20790a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889923:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20790a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889929:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20790a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889933:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eeba200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851424.889936:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20790a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889941:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20790a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889957:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff892e852d8e00) 00010000:00010000:0.0:1788851424.889959:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851424.889962:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20790a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.889968:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b20790a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.890001:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b2078fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390be expref: 10 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.890026:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e83031800) 00010000:00010000:0.0:1788851424.890029:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851424.890033:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b2078fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390be expref: 10 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.890043:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebae00, rc 0) 00000100:00100000:0.0:1788851424.890167:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+9:18730:x1875746000889600:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1284us (1453us total) trans 0 rc 301/301 00000100:00100000:0.0:1788851424.890678:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1788851424.901941:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:18724:x1875746000889472:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 28573us (28811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851424.901957:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:3.0:1788851424.908935:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851424.909136:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000889728 00000100:00100000:1.0:1788851424.909147:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000889728 00000100:00100000:1.0:1788851424.909200:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:1.0:1788851424.909210:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0844575f-19e7-4df3-8155-eb6a1666d628+9:18730:x1875746000889728:12345-192.168.204.27@tcp:700:lfs.0 00000100:00100000:1.0:1788851424.909289:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0844575f-19e7-4df3-8155-eb6a1666d628+9:18730:x1875746000889728:12345-192.168.204.27@tcp:700:lfs.0 Request processed in 80us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851424.909297:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:2.0:1788851424.911937:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851424.912143:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000889984 00000100:00100000:1.0:1788851424.912154:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000889984 00000100:00100000:1.0:1788851424.912213:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:1.0:1788851424.912224:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+9:18730:x1875746000889984:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:1.0:1788851424.912281:0:22769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851424.912309:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b20782a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3902b expref: 9 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.912331:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e83031800) 00010000:00010000:1.0:1788851424.912349:0:22769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851424.912419:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.912434:0:22769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b207869 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3909b expref: 5 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.912443:0:22769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.912985:0:22769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b207869 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3909b expref: 5 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851424.913003:0:22769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b207869 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3909b expref: 5 pid: 22771 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851424.913170:0:22769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87b8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22769:1875746019879168:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851424.913284:0:22769:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccd180 going to sleep for 11 seconds 00000100:00100000:1.0:1788851424.915435:0:22769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87b8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22769:1875746019879168:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851424.915463:0:22769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851424.915997:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851424.916129:0:25803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000890112 00000100:00100000:0.0:1788851424.916137:0:25803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000890112 00010000:00010000:0.0:1788851424.916184:0:25803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b207869 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3909b expref: 6 pid: 22771 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851424.916224:0:25803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:0.0:1788851424.916233:0:25803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b140db83-9b09-493c-aeff-0cdb002e3e74+6:2407:x1875746000890112:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851424.916261:0:25803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851424.916269:0:25803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b207869 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3909b expref: 6 pid: 22771 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.916281:0:25803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b207869 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3909b expref: 6 pid: 22771 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.916303:0:25803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030800/0x3e0030720b207869 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3909b expref: 6 pid: 22771 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.916321:0:25803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e83031800) 00010000:00010000:0.0:1788851424.916326:0:25803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.916336:0:25803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.916344:0:25803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.916376:0:25803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851424.916425:0:25803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2407:x1875746000890112:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 192us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851424.916431:0:25803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00010000:00010000:3.0:1788851424.916563:0:22769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788851424.916576:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788851424.916578:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.916604:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b207918 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.916613:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b207918 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851424.916621:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b207918 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.919451:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b20791f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.919899:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b20791f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.919934:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b20791f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851424.919962:0:22769:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000496b6b11 reply state 00000000e734723a transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b20791f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.919977:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b20791f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.919986:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff892e852d8e00) 00010000:00010000:0.0:1788851424.919990:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788851424.919995:0:22769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788851424.920001:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788851424.920045:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.920054:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.920062:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.920069:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851424.920074:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.920083:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.920094:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e83031800) 00010000:00010000:0.0:1788851424.920097:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851424.920110:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.920116:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207911 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851424.920139:0:22769:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000496b6b11 reply state 00000000e734723a transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b207918 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.920149:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b207918 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851424.920155:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff892ea5408900) 00010000:00010000:0.0:1788851424.920158:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788851424.920160:0:22769:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788851424.920268:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+10:18730:x1875746000889984:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 8042us (8338us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788851424.920277:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000040:00080000:1.0:1788851424.950124:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788851425.068258:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851425.069137:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000890240 00000100:00100000:0.0:1788851425.069150:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000890240 00000100:00100000:0.0:1788851425.069268:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:0.0:1788851425.069280:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+10:18738:x1875746000890240:12345-192.168.204.27@tcp:101:lctl.0 00010000:00010000:0.0:1788851425.069309:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851425.069349:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b207926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390c5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.069425:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b20792d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.069440:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b20792d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.069491:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b20792d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851425.069558:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788851425.069571:0:22770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851425.069630:0:22770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b20792d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.069671:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b207926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390c5 expref: 12 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.069693:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbc00/0x3e0030720b20792d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390c5 expref: 11 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.069701:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8700) 00010000:00010000:0.0:1788851425.069704:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851425.069708:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebbc00, rc 0) 00000100:00100000:0.0:1788851425.069782:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+11:18738:x1875746000890240:12345-192.168.204.27@tcp:101:lctl.0 Request processed in 504us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851425.069789:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:3.0:1788851425.108820:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851425.111563:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000890368 00000100:00100000:0.0:1788851425.111587:0:25721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000890368 00000100:00100000:0.0:1788851425.111672:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1788851425.111683:0:25721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b140db83-9b09-493c-aeff-0cdb002e3e74+5:18739:x1875746000890368:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851425.111704:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851425.111724:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b207934 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390cc expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.111828:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b20793b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.111842:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b20793b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.111855:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b20793b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851425.111902:0:25721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788851425.111906:0:25721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851425.111924:0:25721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b20793b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.111948:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b207934 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390cc expref: 7 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.111966:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebac00/0x3e0030720b20793b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390cc expref: 6 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.111975:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8700) 00010000:00010000:0.0:1788851425.111977:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851425.111981:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e9eebac00, rc 0) 00000100:00100000:0.0:1788851425.112084:0:25721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b140db83-9b09-493c-aeff-0cdb002e3e74+6:18739:x1875746000890368:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 403us (3274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851425.112092:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:3.0:1788851425.115569:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851425.116092:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000890496 00000100:00100000:2.0:1788851425.116101:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000890496 00000100:00100000:2.0:1788851425.116218:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1788851425.116230:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+6:18739:x1875746000890496:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851425.116254:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851425.116277:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b207942 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390d3 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117457:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207949 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117527:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117553:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117642:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b207950 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117650:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b207950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117658:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b207950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117806:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207957 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117815:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207957 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117822:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207957 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851425.117863:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788851425.117867:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851425.117891:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207957 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117904:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117910:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207949 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117917:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207949 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117933:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851425.117937:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207949 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117946:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207949 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117957:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8700) 00010000:00010000:3.0:1788851425.117960:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851425.117965:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207949 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117971:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207949 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.117986:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b207950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.118412:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b207950 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.118419:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b207950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.118425:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851425.118428:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b207950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.118435:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b207950 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.118454:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff892ea5408900) 00010000:00010000:3.0:1788851425.118457:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851425.118461:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b207950 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.118468:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b207950 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.118649:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b207942 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390d3 expref: 8 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.118667:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207957 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390d3 expref: 7 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.118675:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff892e852d8e00) 00010000:00010000:3.0:1788851425.118734:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851425.118738:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6600, rc 0) 00000100:00100000:3.0:1788851425.118863:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+7:18739:x1875746000890496:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 2634us (3306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851425.118872:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1788851425.123303:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851425.123762:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000890624 00000100:00100000:1.0:1788851425.123773:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000890624 00000100:00100000:1.0:1788851425.123946:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:1.0:1788851425.123958:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b140db83-9b09-493c-aeff-0cdb002e3e74+5:18739:x1875746000890624:12345-192.168.204.27@tcp:900:lfs.0 00000100:00100000:1.0:1788851425.124087:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b140db83-9b09-493c-aeff-0cdb002e3e74+5:18739:x1875746000890624:12345-192.168.204.27@tcp:900:lfs.0 Request processed in 131us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851425.124107:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00080000:0.0:1788851425.124420:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788851425.131321:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851425.131445:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000890880 00000100:00100000:1.0:1788851425.131457:0:25721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000890880 00000100:00100000:1.0:1788851425.131641:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:1.0:1788851425.131651:0:25721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b140db83-9b09-493c-aeff-0cdb002e3e74+7:18739:x1875746000890880:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1788851425.131673:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851425.131759:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b20795e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390da expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851425.131892:0:25721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788851425.132242:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b20795e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390da expref: 9 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.132258:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8700) 00010000:00010000:1.0:1788851425.132261:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851425.132267:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b20795e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390da expref: 9 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.132281:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031e00, rc 0) 00000100:00100000:1.0:1788851425.132444:0:25721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b140db83-9b09-493c-aeff-0cdb002e3e74+8:18739:x1875746000890880:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 792us (1132us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1788851425.132452:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:0.0:1788851425.137610:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851425.137738:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000891136 00000100:00100000:3.0:1788851425.137749:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000891136 00000100:00100000:3.0:1788851425.137813:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:3.0:1788851425.137823:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+8:18739:x1875746000891136:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:3.0:1788851425.137886:0:22770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851425.137927:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207957 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390d3 expref: 8 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.137968:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff892e852d8e00) 00010000:00010000:3.0:1788851425.137974:0:22770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851425.138007:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20796c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.138045:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20796c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.138056:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20796c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851425.138429:0:22770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a10349e reply state 00000000d428bc5e transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20796c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.138445:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20796c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.138453:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff892e852d8e00) 00010000:00010000:3.0:1788851425.138456:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788851425.138527:0:22770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788851425.138536:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788851425.138644:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+9:18739:x1875746000891136:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 821us (1043us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788851425.138652:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:2.0:1788851425.142428:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851425.142531:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000891392 00000100:00100000:1.0:1788851425.142551:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000891392 00000100:00100000:1.0:1788851425.142619:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:1.0:1788851425.142630:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b140db83-9b09-493c-aeff-0cdb002e3e74+9:18739:x1875746000891392:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:1.0:1788851425.142887:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b140db83-9b09-493c-aeff-0cdb002e3e74+10:18739:x1875746000891392:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 258us (467us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788851425.142894:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:0.0:1788851425.148768:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851425.148932:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000891648 00000100:00100000:1.0:1788851425.148951:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000891648 00000100:00100000:1.0:1788851425.149057:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:1.0:1788851425.149069:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b140db83-9b09-493c-aeff-0cdb002e3e74+10:18739:x1875746000891648:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1788851425.149098:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851425.149120:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390e1 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149198:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20797a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149213:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20797a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149225:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20797a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149237:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b207981 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149244:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b207981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149250:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b207981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851425.149365:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788851425.149451:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20797a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149459:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20797a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149466:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20797a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149472:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851425.149476:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20797a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149483:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20797a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149494:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8700) 00010000:00010000:1.0:1788851425.149497:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851425.149502:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20797a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149508:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030400/0x3e0030720b20797a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149521:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b207981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149527:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b207981 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149532:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b207981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149559:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851425.149562:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b207981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149575:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b207981 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149585:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff892ea5408900) 00010000:00010000:1.0:1788851425.149587:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851425.149590:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b207981 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149596:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031400/0x3e0030720b207981 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149630:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207973 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390e1 expref: 12 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149640:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8700) 00010000:00010000:1.0:1788851425.149642:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851425.149646:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390e1 expref: 12 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.149655:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892e80031e00, rc 0) 00000100:00100000:1.0:1788851425.150109:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b140db83-9b09-493c-aeff-0cdb002e3e74+11:18739:x1875746000891648:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1040us (1348us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1788851425.150119:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:0.0:1788851425.154724:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851425.154934:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000891776 00000100:00100000:2.0:1788851425.154946:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000891776 00000100:00100000:2.0:1788851425.155036:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:2.0:1788851425.155048:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+11:18739:x1875746000891776:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851425.155072:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851425.155109:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b20798f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390e8 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.155423:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155600/0x3e0030720b207996 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.155440:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155600/0x3e0030720b207996 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.155454:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155600/0x3e0030720b207996 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851425.155482:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788851425.155486:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788851425.155510:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155600/0x3e0030720b207996 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.155556:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155e00/0x3e0030720b20798f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390e8 expref: 13 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.155578:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155600/0x3e0030720b207996 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390e8 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.155588:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff892e852d8e00) 00010000:00010000:2.0:1788851425.155592:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851425.155597:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ec2155600, rc 0) 00000100:00100000:2.0:1788851425.155838:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+12:18739:x1875746000891776:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 790us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851425.155846:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:2.0:1788851425.158957:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851425.159070:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000891904 00000100:00100000:1.0:1788851425.159087:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000891904 00000100:00100000:1.0:1788851425.159143:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:1.0:1788851425.159153:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b140db83-9b09-493c-aeff-0cdb002e3e74+12:18739:x1875746000891904:12345-192.168.204.27@tcp:37:lfs.0 00000100:00100000:1.0:1788851425.163315:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b140db83-9b09-493c-aeff-0cdb002e3e74+12:18739:x1875746000891904:12345-192.168.204.27@tcp:37:lfs.0 Request processed in 4152us (4360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851425.163736:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:0.0:1788851425.170566:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851425.171108:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000892160 00000100:00100000:3.0:1788851425.171120:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000892160 00000100:00100000:3.0:1788851425.171629:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:3.0:1788851425.171641:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5df6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+12:18739:x1875746000892160:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851425.172106:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5df6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+13:18739:x1875746000892160:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 466us (1769us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788851425.172128:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:2.0:1788851425.237905:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851425.238084:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000892288 00000100:00100000:0.0:1788851425.238165:0:25721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000892288 00000100:00100000:0.0:1788851425.238234:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:0.0:1788851425.238245:0:25721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+11:18745:x1875746000892288:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1788851425.238270:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851425.238292:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b20799d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390ef expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.238361:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b2079a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.238375:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b2079a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.238387:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b2079a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.238401:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebb000/0x3e0030720b2079ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.238408:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebb000/0x3e0030720b2079ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.238414:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebb000/0x3e0030720b2079ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.238503:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabc00/0x3e0030720b2079b2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.238525:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabc00/0x3e0030720b2079b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.238534:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabc00/0x3e0030720b2079b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851425.239797:0:25721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788851425.239802:0:25721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851425.239853:0:25721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabc00/0x3e0030720b2079b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240660:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b2079a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240671:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b2079a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240678:0:25721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b2079a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240684:0:25721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eeba200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851425.240688:0:25721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b2079a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240696:0:25721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b2079a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240712:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8700) 00010000:00010000:0.0:1788851425.240715:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851425.240720:0:25721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b2079a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240746:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eeba200/0x3e0030720b2079a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240764:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebb000/0x3e0030720b2079ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240770:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebb000/0x3e0030720b2079ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240776:0:25721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebb000/0x3e0030720b2079ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240781:0:25721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebb000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851425.240784:0:25721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebb000/0x3e0030720b2079ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240790:0:25721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebb000/0x3e0030720b2079ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240798:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff892ea5408900) 00010000:00010000:0.0:1788851425.240801:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851425.240805:0:25721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebb000/0x3e0030720b2079ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240811:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebb000/0x3e0030720b2079ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.240851:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebbe00/0x3e0030720b20799d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390ef expref: 13 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.242058:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdabc00/0x3e0030720b2079b2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390ef expref: 12 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.242067:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff892e852d8e00) 00010000:00010000:0.0:1788851425.242070:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788851425.242073:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdabc00, rc 0) 00000100:00100000:0.0:1788851425.242943:0:25721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+12:18745:x1875746000892288:12345-192.168.204.27@tcp:101:bash.0 Request processed in 4693us (5045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851425.242956:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:1.0:1788851425.256141:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851425.256329:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000892416 00000100:00100000:2.0:1788851425.256340:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000892416 00000100:00100000:2.0:1788851425.256400:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1788851425.256411:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0844575f-19e7-4df3-8155-eb6a1666d628+5:18745:x1875746000892416:12345-192.168.204.27@tcp:900:bash.0 00000100:00100000:2.0:1788851425.256581:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0844575f-19e7-4df3-8155-eb6a1666d628+5:18745:x1875746000892416:12345-192.168.204.27@tcp:900:bash.0 Request processed in 170us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851425.256588:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1788851425.263801:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851425.264065:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000892672 00000100:00100000:0.0:1788851425.264075:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000892672 00000100:00100000:0.0:1788851425.264269:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:0.0:1788851425.264281:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+12:18745:x1875746000892672:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1788851425.264304:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851425.264325:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b2079b9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390f6 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.264434:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.264451:0:22770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155600/0x3e0030720b207996 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390e8 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.264460:0:22770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.264496:0:22770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155600/0x3e0030720b207996 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390e8 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.264527:0:22770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155600/0x3e0030720b207996 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390e8 expref: 12 pid: 22771 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851425.264552:0:22770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22770:1875746019879296:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851425.264637:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6cbfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788851425.270726:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851425.270942:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000892800 00000100:00100000:3.0:1788851425.271051:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000892800 00010000:00010000:3.0:1788851425.271105:0:22755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155600/0x3e0030720b207996 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390e8 expref: 13 pid: 22771 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851425.271150:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1788851425.271160:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+13:2408:x1875746000892800:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851425.271178:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851425.271185:0:22755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155600/0x3e0030720b207996 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390e8 expref: 13 pid: 22771 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.271198:0:22755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155600/0x3e0030720b207996 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390e8 expref: 13 pid: 22771 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.271221:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff892e852d8e00) 00010000:00010000:3.0:1788851425.271226:0:22755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.271237:0:22755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.271245:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.271264:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851425.271315:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+13:2408:x1875746000892800:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 156us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851425.271335:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00010000:00010000:0.0:1788851425.272729:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ec2155600/0x3e0030720b207996 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390e8 expref: 12 pid: 22771 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851425.272753:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22770:1875746019879296:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851425.272776:0:22770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.272785:0:22770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.272791:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.272814:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaac00/0x3e0030720b2079c7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.272826:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaac00/0x3e0030720b2079c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.272836:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaac00/0x3e0030720b2079c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.273946:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b2079ce lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.273974:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b2079ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.273984:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b2079ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851425.273998:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788851425.274066:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.274075:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.274083:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.274089:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdaa400 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851425.274387:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.274399:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.274413:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff892e852d8e00) 00010000:00010000:0.0:1788851425.274415:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851425.274420:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.274426:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079c0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851425.274438:0:22770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5e1d34f reply state 0000000016eebcf7 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaac00/0x3e0030720b2079c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.274457:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaac00/0x3e0030720b2079c7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.274464:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff892e852d8500) 00010000:00010000:0.0:1788851425.274466:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788851425.274469:0:22770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788851425.274509:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b2079b9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390f6 expref: 15 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.274524:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b2079ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390f6 expref: 14 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.274532:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851425.274534:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788851425.275293:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdab600, rc 0) 00000100:00100000:0.0:1788851425.275367:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+15:18745:x1875746000892672:12345-192.168.204.27@tcp:101:bash.0 Request processed in 11086us (11575us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788851425.275377:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:1.0:1788851425.301414:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851425.301529:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000892928 00000100:00100000:0.0:1788851425.301549:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000892928 00000100:00100000:0.0:1788851425.301622:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:0.0:1788851425.301634:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+15:18745:x1875746000892928:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1788851425.301668:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851425.301689:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b2079dc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c390fd expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.301761:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.301789:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.301802:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851425.301845:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788851425.301849:0:22769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851425.301868:0:22769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.301879:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.301904:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b2079dc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390fd expref: 17 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.301924:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390fd expref: 16 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.301933:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851425.301936:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851425.301941:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdaa400, rc 0) 00000100:00100000:0.0:1788851425.301998:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+16:18745:x1875746000892928:12345-192.168.204.27@tcp:101:bash.0 Request processed in 366us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851425.302005:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:1.0:1788851425.307376:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851425.307586:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000893184 00000100:00100000:3.0:1788851425.307596:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000893184 00000100:00100000:3.0:1788851425.307713:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:3.0:1788851425.307725:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0844575f-19e7-4df3-8155-eb6a1666d628+16:18745:x1875746000893184:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:3.0:1788851425.308075:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0844575f-19e7-4df3-8155-eb6a1666d628+17:18745:x1875746000893184:12345-192.168.204.27@tcp:35:bash.0 Request processed in 350us (706us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788851425.308083:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00010000:00010000:3.0:1788851425.396866:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851425.409185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851425.412811:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000893440 00000100:00100000:2.0:1788851425.412828:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000893440 00000100:00100000:2.0:1788851425.412968:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:2.0:1788851425.412980:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+17:18755:x1875746000893440:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1788851425.413039:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851425.413062:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2079ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c39104 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851425.413177:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788851425.413301:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2079ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39104 expref: 19 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.413315:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff892e852d8700) 00010000:00010000:2.0:1788851425.413318:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851425.413323:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b2079ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39104 expref: 19 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.413337:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95000, rc 0) 00000100:00100000:2.0:1788851425.413413:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+18:18755:x1875746000893440:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 435us (4237us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1788851425.413436:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:1.0:1788851425.418336:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851425.418502:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000893696 00000100:00100000:3.0:1788851425.418514:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000893696 00000100:00100000:3.0:1788851425.418590:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:3.0:1788851425.418600:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0844575f-19e7-4df3-8155-eb6a1666d628+18:18755:x1875746000893696:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851425.418849:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0844575f-19e7-4df3-8155-eb6a1666d628+19:18755:x1875746000893696:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 249us (522us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1788851425.418857:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:1.0:1788851425.471166:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851425.471664:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000893952 00000100:00100000:0.0:1788851425.471676:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000893952 00000100:00100000:0.0:1788851425.471737:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:0.0:1788851425.471764:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+19:18758:x1875746000893952:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1788851425.471791:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851425.471814:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab400/0x3e0030720b2079f8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c3910b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.471949:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b2079ff lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.471965:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b2079ff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.471977:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b2079ff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851425.471989:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788851425.472153:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab400/0x3e0030720b2079f8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3910b expref: 22 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.472171:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b2079ff lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3910b expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.472180:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851425.472183:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851425.472187:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdaa800, rc 0) 00000100:00100000:0.0:1788851425.472641:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+21:18758:x1875746000893952:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 878us (1482us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788851425.472702:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:0.0:1788851425.481211:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851425.481250:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851425.481373:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000894080 00000100:00100000:3.0:1788851425.481382:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000894080 00000100:00100000:3.0:1788851425.481433:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:3.0:1788851425.481443:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+21:18758:x1875746000894080:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:3.0:1788851425.481602:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a0d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.481618:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a0d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.481638:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a0d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.481676:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a0d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.481684:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a0d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.481690:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a0d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.481696:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851425.481700:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a0d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.481707:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a0d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.481718:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:3.0:1788851425.481721:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851425.481726:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a0d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851425.481733:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a0d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851425.481809:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+21:18758:x1875746000894080:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 367us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851425.481817:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:1.0:1788851425.487476:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000894208 00000100:00100000:1.0:1788851425.487493:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000894208 00000100:00100000:1.0:1788851425.487599:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:1.0:1788851425.487611:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0844575f-19e7-4df3-8155-eb6a1666d628+21:2410:x1875746000894208:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851425.487627:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851425.487652:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b2079ff lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3910b expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851425.487674:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:1.0:1788851425.487679:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851425.487751:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0844575f-19e7-4df3-8155-eb6a1666d628+20:2410:x1875746000894208:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 142us (6500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851425.487759:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1788851425.501408:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851425.501676:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000894464 00000100:00100000:3.0:1788851425.501687:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000894464 00000100:00100000:3.0:1788851425.501749:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1788851425.501759:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0844575f-19e7-4df3-8155-eb6a1666d628+20:18758:x1875746000894464:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1788851425.501982:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0844575f-19e7-4df3-8155-eb6a1666d628+21:18758:x1875746000894464:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 223us (584us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788851425.502000:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1788851425.529229:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851425.529284:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851425.529319:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851425.529355:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851425.529395:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851425.529726:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000894848 00000100:00100000:1.0:1788851425.529736:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000894848 00000100:00100000:1.0:1788851425.529806:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000895104 00000100:00100000:1.0:1788851425.529810:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000895104 00000100:00100000:1.0:1788851425.529824:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000894720 00000100:00100000:1.0:1788851425.529827:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000894720 00000100:00100000:1.0:1788851425.529839:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000894976 00000100:00100000:1.0:1788851425.529841:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000894976 00000100:00100000:1.0:1788851425.529856:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:1.0:1788851425.529866:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:2409:x1875746000894848:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851425.529939:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:2409:x1875746000894848:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 74us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851425.529947:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:1.0:1788851425.529966:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1788851425.529972:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2409:x1875746000895104:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851425.529996:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2409:x1875746000895104:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851425.530001:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1788851425.530048:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1788851425.530055:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:2409:x1875746000894720:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851425.530082:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:2409:x1875746000894720:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851425.530087:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1788851425.530100:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1788851425.530106:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2409:x1875746000894976:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851425.530128:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2409:x1875746000894976:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851425.530144:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:3.0:1788851425.530796:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000894592 00000100:00100000:3.0:1788851425.530805:0:22763:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000894592 00000100:00100000:3.0:1788851425.530854:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:3.0:1788851425.530863:0:22763:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea7c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:2409:x1875746000894592:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1788851425.530910:0:22763:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea7c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:2409:x1875746000894592:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 49us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851425.530917:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00080000:2.0:1788851425.532100:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851425.532110:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788851425.844731:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788851425.888602:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851425.888750:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000895360 00000100:00100000:0.0:1788851425.888762:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000895360 00000100:00100000:0.0:1788851425.888838:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:0.0:1788851425.888848:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+21:18789:x1875746000895360:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:0.0:1788851425.888879:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851425.888905:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a14 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c39112 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.889095:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab400/0x3e0030720b207a1b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.889111:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab400/0x3e0030720b207a1b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.889123:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab400/0x3e0030720b207a1b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851425.889135:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788851425.889260:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a14 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39112 expref: 24 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.889280:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab400/0x3e0030720b207a1b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39112 expref: 23 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.889289:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851425.889292:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851425.889296:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdab400, rc 0) 00000100:00100000:0.0:1788851425.889359:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+23:18789:x1875746000895360:12345-192.168.204.27@tcp:101:cat.0 Request processed in 511us (784us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788851425.889380:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:3.0:1788851425.901460:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851425.901746:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000895616 00000100:00100000:2.0:1788851425.901757:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000895616 00000100:00100000:2.0:1788851425.901813:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:2.0:1788851425.901823:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0844575f-19e7-4df3-8155-eb6a1666d628+23:18789:x1875746000895616:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:2.0:1788851425.902164:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0844575f-19e7-4df3-8155-eb6a1666d628+24:18789:x1875746000895616:12345-192.168.204.27@tcp:35:cat.0 Request processed in 340us (714us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788851425.902172:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:1.0:1788851425.909442:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851425.910720:0:25802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000895744 00000100:00100000:0.0:1788851425.910733:0:25802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000895744 00000100:00100000:0.0:1788851425.910810:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:0.0:1788851425.910820:0:25802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0844575f-19e7-4df3-8155-eb6a1666d628+24:2408:x1875746000895744:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851425.910836:0:25802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851425.910864:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab400/0x3e0030720b207a1b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39112 expref: 24 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851425.910885:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851425.910891:0:25802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851425.910979:0:25802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0844575f-19e7-4df3-8155-eb6a1666d628+23:2408:x1875746000895744:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 159us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851425.910986:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:3.0:1788851425.995513:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851425.995675:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000896000 00000100:00100000:2.0:1788851425.995700:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000896000 00000100:00100000:2.0:1788851425.995762:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:2.0:1788851425.995774:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+23:18795:x1875746000896000:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:2.0:1788851425.995808:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851425.995828:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b207a29 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c39119 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.995934:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b207a30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.995969:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b2079ce lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390f6 expref: 24 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.995978:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390fd expref: 24 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.995986:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b207a30 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.996317:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390fd expref: 24 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.996333:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390fd expref: 24 pid: 22769 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851425.996348:0:22771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1875746019879424:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851425.996439:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b2079ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390f6 expref: 24 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851425.996448:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b2079ce lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390f6 expref: 24 pid: 22770 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851425.996468:0:22771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1875746019879552:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851425.996492:0:22771:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81e13000 going to sleep for 11 seconds 00000100:00100000:1.0:1788851426.001612:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851426.001965:0:22771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1875746019879424:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851426.001978:0:22771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e17800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1875746019879552:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851426.002063:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b207a30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851426.002383:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851426.002463:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000896128 00000100:00100000:0.0:1788851426.002471:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000896128 00010000:00010000:0.0:1788851426.002531:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390fd expref: 25 pid: 22769 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851426.002565:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000896256 00000100:00100000:0.0:1788851426.002569:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000896256 00010000:00010000:0.0:1788851426.002591:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b2079ce lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390f6 expref: 26 pid: 22770 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851426.002615:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:0.0:1788851426.002624:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0844575f-19e7-4df3-8155-eb6a1666d628+26:2407:x1875746000896128:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851426.002650:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851426.002658:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390fd expref: 26 pid: 22769 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.002672:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390fd expref: 26 pid: 22769 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.002706:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b2079e3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390fd expref: 26 pid: 22769 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.002723:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851426.002728:0:22754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b207a30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.002737:0:22754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b207a30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.002744:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851426.002797:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0844575f-19e7-4df3-8155-eb6a1666d628+25:2407:x1875746000896128:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 174us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.002805:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:0.0:1788851426.002822:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:0.0:1788851426.002828:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d879e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0844575f-19e7-4df3-8155-eb6a1666d628+24:2407:x1875746000896256:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851426.002835:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851426.002841:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b2079ce lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390f6 expref: 24 pid: 22770 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.002861:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b2079ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390f6 expref: 24 pid: 22770 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.002874:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b2079ce lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c390f6 expref: 24 pid: 22770 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.002884:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851426.002888:0:22754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b207a30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.002895:0:22754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b207a30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.002903:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b207a30 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.002931:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851426.002951:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d879e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0844575f-19e7-4df3-8155-eb6a1666d628+23:2407:x1875746000896256:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 123us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.002957:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00010000:00010000:0.0:1788851426.003007:0:22771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b207a30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.003045:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b207a30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851426.003063:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788851426.003210:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b207a29 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39119 expref: 24 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.003237:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95c00/0x3e0030720b207a30 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39119 expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.003244:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851426.003247:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788851426.003249:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95c00, rc 0) 00000100:00100000:0.0:1788851426.003274:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+23:18795:x1875746000896000:12345-192.168.204.27@tcp:101:dd.0 Request processed in 7503us (7772us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788851426.003281:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00080000:2.0:1788851426.003415:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851426.012273:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851426.012998:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000896384 00000100:00100000:0.0:1788851426.013031:0:25721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000896384 00000100:00100000:0.0:1788851426.013088:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:0.0:1788851426.013099:0:25721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+23:18795:x1875746000896384:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:0.0:1788851426.013127:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851426.013148:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a3e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c39120 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.013185:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b207a45 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.013201:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b207a45 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.013214:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b207a45 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.013336:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a3e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39120 expref: 25 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.013362:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b207a45 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39120 expref: 24 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.013370:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851426.013373:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788851426.013377:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdaa400, rc 0) 00000100:00100000:0.0:1788851426.013447:0:25721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+24:18795:x1875746000896384:12345-192.168.204.27@tcp:101:dd.0 Request processed in 350us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.013465:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:0.0:1788851426.020278:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851426.020727:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000896640 00000100:00100000:3.0:1788851426.020739:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000896640 00000100:00100000:3.0:1788851426.020798:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:3.0:1788851426.020808:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+24:18795:x1875746000896640:12345-192.168.204.27@tcp:36:dd.0 00010000:00010000:3.0:1788851426.021050:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a4c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.021068:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a4c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.021081:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a4c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851426.021141:0:22770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788851426.021163:0:22770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044fef400 reply state 0000000073436000 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a4c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.021175:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a4c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.021183:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:3.0:1788851426.021186:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788851426.021190:0:22770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851426.021946:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+27:18795:x1875746000896640:12345-192.168.204.27@tcp:36:dd.0 Request processed in 1134us (1672us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788851426.021956:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000020:00080000:3.0:1788851426.021961:0:22770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788851426.025362:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851426.026385:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000896768 00000100:00100000:0.0:1788851426.026397:0:25721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000896768 00000100:00100000:0.0:1788851426.026479:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:0.0:1788851426.026491:0:25721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+27:18795:x1875746000896768:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:0.0:1788851426.026536:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851426.026558:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a53 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c39127 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.026696:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a53 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39127 expref: 28 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.026714:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a53 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39127 expref: 28 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.026734:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851426.026749:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851426.026754:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdab600, rc 0) 00000100:00100000:0.0:1788851426.026826:0:25721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+28:18795:x1875746000896768:12345-192.168.204.27@tcp:101:dd.0 Request processed in 337us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.026833:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:1.0:1788851426.044140:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851426.044240:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000897024 00000100:00100000:3.0:1788851426.044251:0:22755:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000897024 00000100:00100000:3.0:1788851426.044326:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:3.0:1788851426.044337:0:22755:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0844575f-19e7-4df3-8155-eb6a1666d628+28:18795:x1875746000897024:12345-192.168.204.27@tcp:103:dd.0 00010000:00010000:3.0:1788851426.044353:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851426.044379:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a53 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39127 expref: 28 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.044411:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:3.0:1788851426.044417:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851426.044480:0:22755:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0844575f-19e7-4df3-8155-eb6a1666d628+27:18795:x1875746000897024:12345-192.168.204.27@tcp:103:dd.0 Request processed in 144us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851426.044504:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:2.0:1788851426.050212:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851426.050289:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000897152 00000100:00100000:0.0:1788851426.050299:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000897152 00000100:00100000:0.0:1788851426.050359:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:0.0:1788851426.050371:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+27:18795:x1875746000897152:12345-192.168.204.27@tcp:58:dd.0 00010000:00010000:0.0:1788851426.050473:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a5a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.050490:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a5a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.050502:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a5a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851426.053580:0:22771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851426.053615:0:22771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788851426.053839:0:22771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788851426.054004:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+27:18795:x1875746000897152:12345-192.168.204.27@tcp:58:dd.0 Request processed in 3630us (3795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.055835:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:1.0:1788851426.065534:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851426.065729:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000897280 00000100:00100000:0.0:1788851426.065740:0:25721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000897280 00000100:00100000:0.0:1788851426.065798:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:0.0:1788851426.065808:0:25721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+27:18795:x1875746000897280:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:0.0:1788851426.065828:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851426.065862:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b207a61 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c3912e expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.065916:0:25721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a5a lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.065928:0:25721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b207a61 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3912e expref: 28 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.065947:0:25721:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a5a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.065961:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b207a61 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3912e expref: 28 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.065974:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851426.065978:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851426.065982:0:25721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b207a61 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3912e expref: 28 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.065990:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdaa800, rc 0) 00000100:00100000:0.0:1788851426.066083:0:25721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+28:18795:x1875746000897280:12345-192.168.204.27@tcp:101:dd.0 Request processed in 275us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.066091:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00010000:00010000:0.0:1788851426.420698:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788851426.869960:0:22807:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788851426.869970:0:22807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788851426.869997:0:22807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788851426.870006:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788851426.870158:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea590e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22807:1875746019879680:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788851426.870256:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851426.877836:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea590e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22807:1875746019879680:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788851426.878127:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851426.878240:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000897408 00000100:00100000:3.0:1788851426.878248:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000897408 00000100:00100000:3.0:1788851426.878295:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:3.0:1788851426.878305:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+28:18796:x1875746000897408:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788851426.878337:0:22770:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788851426.878460:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+28:18796:x1875746000897408:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 155us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851426.878467:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:1.0:1788851426.880877:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851426.880972:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000897536 00000100:00100000:0.0:1788851426.880981:0:25721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000897536 00000100:00100000:0.0:1788851426.881073:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:0.0:1788851426.881083:0:25721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+28:18796:x1875746000897536:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788851426.881168:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab200/0x3e0030720b207a68 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881185:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab200/0x3e0030720b207a68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881196:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab200/0x3e0030720b207a68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881249:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b207a6f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881257:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b207a6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881263:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b207a6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881285:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a76 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881294:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881301:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851426.881350:0:25721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788851426.881355:0:25721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788851426.881370:0:25721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881381:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab200/0x3e0030720b207a68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881521:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab200/0x3e0030720b207a68 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881530:0:25721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab200/0x3e0030720b207a68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881537:0:25721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851426.881542:0:25721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab200/0x3e0030720b207a68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881550:0:25721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab200/0x3e0030720b207a68 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881562:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892e83031300) 00010000:00010000:0.0:1788851426.881566:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851426.881571:0:25721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab200/0x3e0030720b207a68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881577:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab200/0x3e0030720b207a68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881591:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b207a6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881597:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b207a6f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881603:0:25721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b207a6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881608:0:25721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdaa600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851426.881617:0:25721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b207a6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881624:0:25721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b207a6f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881631:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff892e852d8f00) 00010000:00010000:0.0:1788851426.881633:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851426.881636:0:25721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b207a6f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881642:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa600/0x3e0030720b207a6f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881655:0:25721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881661:0:25721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a76 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881666:0:25721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a76 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881671:0:25721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851426.881674:0:25721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a76 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881679:0:25721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a76 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881687:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851426.881689:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851426.881698:0:25721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a76 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.881704:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207a76 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851426.881876:0:25721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+28:18796:x1875746000897536:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 792us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.881885:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:1.0:1788851426.886524:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851426.886777:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000897792 00000100:00100000:3.0:1788851426.886789:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000897792 00000100:00100000:3.0:1788851426.886850:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:3.0:1788851426.886860:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+28:18796:x1875746000897792:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851426.886883:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851426.886904:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207a7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c39135 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.887048:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a84 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.887077:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a84 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.887091:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a84 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851426.887104:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788851426.887184:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a84 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.887197:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a84 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.887204:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a84 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.887210:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:3.0:1788851426.887214:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a84 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.887220:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a84 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.887232:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:3.0:1788851426.887235:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788851426.887239:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a84 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.887245:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a84 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.887284:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207a7d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39135 expref: 30 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.887301:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff892e83031300) 00010000:00010000:3.0:1788851426.887304:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851426.887308:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207a7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39135 expref: 30 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.887318:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7c00, rc 0) 00000100:00100000:3.0:1788851426.887368:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+29:18796:x1875746000897792:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 509us (865us total) trans 12884901907 rc 301/301 00000100:00100000:3.0:1788851426.887375:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:2.0:1788851426.892102:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851426.892189:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000897920 00000100:00100000:1.0:1788851426.892198:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000897920 00000100:00100000:1.0:1788851426.892255:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:1.0:1788851426.892264:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+29:18796:x1875746000897920:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788851426.892295:0:22769:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788851426.892425:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+29:18796:x1875746000897920:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 162us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851426.892433:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:1.0:1788851426.898694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851426.901105:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000898176 00000100:00100000:3.0:1788851426.901120:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000898176 00000100:00100000:3.0:1788851426.901176:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:3.0:1788851426.901186:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+29:18796:x1875746000898176:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851426.901206:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851426.901225:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207a92 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c3913c expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788851426.901637:0:22770:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:3.0:1788851426.901644:0:22770:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:3.0:1788851426.901680:0:22770:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:3.0:1788851426.901838:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a99 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.901853:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a99 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.901865:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a99 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.901934:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207a92 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3913c expref: 32 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.901951:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a99 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3913c expref: 31 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.901959:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff892ea5408300) 00010000:00010000:3.0:1788851426.901962:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851426.901966:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e6000, rc 0) 00000100:00100000:3.0:1788851426.902059:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+31:18796:x1875746000898176:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 875us (3387us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1788851426.902067:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:3.0:1788851426.904882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851426.905129:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000898432 00000100:00100000:1.0:1788851426.905141:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000898432 00000100:00100000:1.0:1788851426.905208:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:1.0:1788851426.905220:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea590e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+31:18796:x1875746000898432:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788851426.905274:0:22769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851426.905302:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6000/0x3e0030720b207a99 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3913c expref: 31 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.905337:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff892ea5408300) 00010000:00010000:1.0:1788851426.905347:0:22769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851426.905369:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207aa7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.905382:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207aa7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.905391:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207aa7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.905422:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207aae lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd9696b44 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.905429:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207aae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9696b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.905442:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207aae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9696b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.905483:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207aa7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.905490:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207aa7 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.905496:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207aa7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.905501:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851426.905515:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207aa7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.905976:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207aa7 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.905988:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff892e852d8e00) 00010000:00010000:1.0:1788851426.905991:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851426.905995:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207aa7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.906001:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80031e00/0x3e0030720b207aa7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.906052:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207aae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9696b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.906059:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207aae lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9696b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.906064:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207aae lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9696b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.906069:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:1.0:1788851426.906072:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207aae lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9696b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.906077:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207aae lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd9696b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.906083:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xd9696b44 (ffff892e83031200) 00010000:00010000:1.0:1788851426.906085:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851426.906087:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207aae lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd9696b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.906103:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207aae lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd9696b44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851426.906181:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea590e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0844575f-19e7-4df3-8155-eb6a1666d628+30:18796:x1875746000898432:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 962us (1305us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788851426.906188:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:2.0:1788851426.910407:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851426.910485:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000898560 00000100:00100000:3.0:1788851426.910495:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000898560 00000100:00100000:3.0:1788851426.910580:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:3.0:1788851426.910590:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+30:18796:x1875746000898560:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851426.910610:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851426.910631:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b207ab5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c39143 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.910667:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207abc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.910694:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207abc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.910725:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207abc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.910830:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b207ab5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39143 expref: 32 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.910849:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7c00/0x3e0030720b207abc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39143 expref: 31 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.910857:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff892ea5408500) 00010000:00010000:3.0:1788851426.910860:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851426.910864:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7c00, rc 0) 00000100:00100000:3.0:1788851426.910923:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+31:18796:x1875746000898560:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 335us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851426.910931:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:3.0:1788851426.913830:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851426.913924:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000898816 00000100:00100000:0.0:1788851426.913935:0:25721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000898816 00000100:00100000:0.0:1788851426.913993:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:0.0:1788851426.914002:0:25721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+31:18796:x1875746000898816:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788851426.914115:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207ac3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.914131:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207ac3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.914143:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207ac3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851426.914319:0:25721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1788851426.914329:0:25721:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760973315924ns, next at 761973312939ns, rc = 0 00000004:00010000:0.0:1788851426.914377:0:25721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009ba84f3 reply state 0000000090bf2d35 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207ac3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.914390:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207ac3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.914397:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff892ea5408500) 00010000:00010000:0.0:1788851426.914426:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788851426.914431:0:25721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851426.914561:0:25721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+33:18796:x1875746000898816:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 560us (741us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788851426.914569:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:1.0:1788851426.919241:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851426.919313:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000898944 00000100:00100000:3.0:1788851426.919324:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000898944 00000100:00100000:3.0:1788851426.919382:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:3.0:1788851426.919409:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+33:18796:x1875746000898944:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851426.919562:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851426.919585:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7400/0x3e0030720b207aca lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c3914a expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.919644:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7400/0x3e0030720b207aca lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3914a expref: 34 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.919855:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7400/0x3e0030720b207aca lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3914a expref: 34 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.919876:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff892ea5408500) 00010000:00010000:3.0:1788851426.919880:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851426.919883:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7400, rc 0) 00000100:00100000:3.0:1788851426.919950:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+34:18796:x1875746000898944:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 559us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851426.919957:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:3.0:1788851426.924751:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851426.924968:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000899072 00000100:00100000:1.0:1788851426.924979:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000899072 00000100:00100000:1.0:1788851426.925165:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:1.0:1788851426.925177:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:2407:x1875746000899072:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788851426.925422:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+6:2407:x1875746000899072:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 246us (679us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788851426.925431:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:1.0:1788851426.929004:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851426.929261:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000899328 00000100:00100000:2.0:1788851426.929273:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000899328 00000100:00100000:1.0:1788851426.929544:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:1.0:1788851426.929556:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0844575f-19e7-4df3-8155-eb6a1666d628+34:18796:x1875746000899328:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788851426.930095:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0844575f-19e7-4df3-8155-eb6a1666d628+35:18796:x1875746000899328:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 539us (1098us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1788851426.930103:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:3.0:1788851426.934220:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851426.934334:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000899584 00000100:00100000:0.0:1788851426.934343:0:25721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000899584 00000100:00100000:0.0:1788851426.934609:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:0.0:1788851426.934622:0:25721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+35:18796:x1875746000899584:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788851426.934800:0:25721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+35:18796:x1875746000899584:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 181us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.934808:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:2.0:1788851426.940905:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851426.941028:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000899712 00000100:00100000:3.0:1788851426.941040:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000899712 00000100:00100000:3.0:1788851426.941136:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:3.0:1788851426.941146:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+35:18796:x1875746000899712:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851426.941167:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851426.941189:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b207ad1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c39151 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.941287:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7a00/0x3e0030720b207ad8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.941314:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7a00/0x3e0030720b207ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.941325:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7a00/0x3e0030720b207ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851426.941383:0:22770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788851426.941417:0:22770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7a00/0x3e0030720b207ad8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.941456:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6c00/0x3e0030720b207ad1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39151 expref: 37 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.941475:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7a00/0x3e0030720b207ad8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39151 expref: 36 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851426.941484:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff892ea5408500) 00010000:00010000:3.0:1788851426.941486:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788851426.941490:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892d876e7a00, rc 0) 00000100:00100000:3.0:1788851426.941628:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+36:18796:x1875746000899712:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 483us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851426.941635:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:1.0:1788851426.944993:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851426.945115:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000899840 00000100:00100000:0.0:1788851426.945124:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000899840 00000100:00100000:0.0:1788851426.945182:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:0.0:1788851426.945191:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0844575f-19e7-4df3-8155-eb6a1666d628+6:2409:x1875746000899840:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851426.945208:0:24278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851426.945228:0:24278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002474a873/0x3e0030720b207adf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c39158 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851426.945254:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fb4e2, blocks: 0x0 00010000:00010000:0.0:1788851426.945276:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=761s v=(0 0) 00010000:00010000:0.0:1788851426.945281:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851426.945300:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002474a873/0x3e0030720b207adf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39158 expref: 7 pid: 24278 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.945318:0:24278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002474a873/0x3e0030720b207adf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39158 expref: 7 pid: 24278 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.945345:0:24278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdaa600, rc 0) 00000100:00100000:0.0:1788851426.945521:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0844575f-19e7-4df3-8155-eb6a1666d628+7:2409:x1875746000899840:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 330us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.945537:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:1.0:1788851426.958208:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851426.958280:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000900096 00000100:00100000:0.0:1788851426.958291:0:25721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000900096 00000100:00100000:0.0:1788851426.958347:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:0.0:1788851426.958358:0:25721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+36:18796:x1875746000900096:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788851426.958551:0:25721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+36:18796:x1875746000900096:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 193us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.958559:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:0.0:1788851426.965781:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851426.967850:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000900224 00000100:00100000:2.0:1788851426.967865:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000900224 00000100:00100000:2.0:1788851426.967932:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:2.0:1788851426.967942:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+36:18796:x1875746000900224:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788851426.978077:0:22749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:1.0:1788851426.978095:0:22749:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788851426.978301:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b207918 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978315:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b207918 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978324:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b207918 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978331:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e7600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851426.978336:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b207918 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978345:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b207918 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978373:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff892ea5408900) 00010000:00010000:0.0:1788851426.978376:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851426.978382:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b207918 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978390:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7600/0x3e0030720b207918 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978430:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b20791f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978446:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b20791f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978452:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b20791f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978457:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e9eebae00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851426.978460:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b20791f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978467:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b20791f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978475:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff892e852d8e00) 00010000:00010000:0.0:1788851426.978477:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851426.978481:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b20791f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978487:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e9eebae00/0x3e0030720b20791f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978523:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaac00/0x3e0030720b2079c7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978531:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaac00/0x3e0030720b2079c7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978537:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaac00/0x3e0030720b2079c7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978543:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdaac00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851426.978546:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaac00/0x3e0030720b2079c7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978551:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaac00/0x3e0030720b2079c7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978559:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff892e852d8500) 00010000:00010000:0.0:1788851426.978561:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851426.978564:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaac00/0x3e0030720b2079c7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978569:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaac00/0x3e0030720b2079c7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978584:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a4c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978591:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a4c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978596:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a4c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978610:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851426.978613:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a4c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978620:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a4c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978629:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851426.978631:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851426.978634:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a4c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978641:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6600/0x3e0030720b207a4c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978653:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207ac3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978659:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207ac3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978665:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207ac3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978687:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab600 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851426.978690:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207ac3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978697:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207ac3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978716:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff892ea5408500) 00010000:00010000:0.0:1788851426.978718:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788851426.978722:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207ac3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.978728:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab600/0x3e0030720b207ac3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788851426.978773:0:22749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:0.0:1788851426.979540:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0844575f-19e7-4df3-8155-eb6a1666d628+15:18796:x1875746000900224:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 11593us (13761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.979552:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:2.0:1788851426.979748:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851426.979764:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019879808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788851426.979818:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851426.979868:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019879808 00000100:00100000:2.0:1788851426.979876:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019879808 00000100:00100000:2.0:1788851426.979926:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788851426.979934:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019879808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788851426.980075:0:24280:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788851426.980079:0:24280:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788851426.980081:0:24280:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788851426.980083:0:24280:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788851426 -> 1788851426 00002000:00010000:2.0:1788851426.980086:0:24280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788851426.980118:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019879808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (299us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788851426.980134:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788851426.980154:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788851426.980184:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff892e83e16300/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788851426.980189:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892e83e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019879808:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788851426.985480:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20796c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.985496:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20796c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.985515:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20796c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.985522:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892d876e6200 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:0.0:1788851426.985527:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20796c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.985535:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20796c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.985551:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff892e852d8e00) 00010000:00010000:0.0:1788851426.985554:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788851426.985558:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20796c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.985582:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e6200/0x3e0030720b20796c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851426.985713:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851426.985934:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000900352 00000100:00100000:0.0:1788851426.985943:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000900352 00000100:00100000:0.0:1788851426.985991:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1788851426.986000:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0844575f-19e7-4df3-8155-eb6a1666d628+7:2407:x1875746000900352:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788851426.986126:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0844575f-19e7-4df3-8155-eb6a1666d628+7:2407:x1875746000900352:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 127us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.986133:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1788851426.989756:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851426.989898:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000900608 00000100:00100000:2.0:1788851426.989908:0:25721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000900608 00000100:00100000:2.0:1788851426.989966:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:2.0:1788851426.989976:0:25721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+15:18796:x1875746000900608:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788851426.990056:0:25721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851426.990082:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7a00/0x3e0030720b207ad8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39151 expref: 15 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851426.990104:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff892ea5408500) 00010000:00010000:2.0:1788851426.990109:0:25721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851426.990138:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b207ae6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851426.990153:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b207ae6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851426.990163:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b207ae6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851426.990294:0:25721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003961c21d reply state 00000000c76d2789 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b207ae6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851426.990305:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94200/0x3e0030720b207ae6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851426.990325:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff892ea5408500) 00010000:00010000:2.0:1788851426.990328:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788851426.990331:0:25721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788851426.990453:0:25721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+16:18796:x1875746000900608:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 478us (706us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788851426.990461:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:2.0:1788851426.993484:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851426.993688:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000900736 00000100:00100000:0.0:1788851426.993697:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000900736 00000100:00100000:0.0:1788851426.993752:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:0.0:1788851426.993762:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e83e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0844575f-19e7-4df3-8155-eb6a1666d628+7:18796:x1875746000900736:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851426.993780:0:24280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851426.993800:0:24280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c3915f expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.993831:0:24280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002474a873/0x3e0030720b207adf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39158 expref: 8 pid: 24278 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.993840:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851426.993845:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851426.993851:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3915f expref: 8 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.993899:0:24280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002474a873/0x3e0030720b207adf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39158 expref: 8 pid: 24278 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851426.993914:0:24280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002474a873/0x3e0030720b207adf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39158 expref: 8 pid: 24278 timeout: 861 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851426.993929:0:24280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5992680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24280:1875746019879936:192.168.204.27@tcp:104: 00000100:00100000:0.0:1788851426.994043:0:24280:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2180c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851426.999171:0:24280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5992680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24280:1875746019879936:192.168.204.27@tcp:104: 00010000:00010000:0.0:1788851426.999212:0:24280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3915f expref: 8 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851426.999224:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00010000:00010000:0.0:1788851426.999234:0:24280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebbdab600, rc 0) 00000100:00100000:0.0:1788851426.999299:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e83e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0844575f-19e7-4df3-8155-eb6a1666d628+8:18796:x1875746000900736:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 5537us (5823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851426.999308:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:1.0:1788851426.999762:0:25802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000900864 00000100:00100000:1.0:1788851426.999771:0:25802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000900864 00010000:00010000:1.0:1788851426.999803:0:25802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002474a873/0x3e0030720b207adf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39158 expref: 8 pid: 24278 timeout: 861 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851426.999838:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1788851426.999848:0:25802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0844575f-19e7-4df3-8155-eb6a1666d628+8:2407:x1875746000900864:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851426.999860:0:25802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851426.999881:0:25802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002474a873/0x3e0030720b207adf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39158 expref: 8 pid: 24278 timeout: 861 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.999894:0:25802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002474a873/0x3e0030720b207adf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39158 expref: 8 pid: 24278 timeout: 861 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.999915:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002474a873/0x3e0030720b207adf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39158 expref: 8 pid: 24278 timeout: 861 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.999930:0:25802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851426.999933:0:25802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851426.999940:0:25802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3915f expref: 7 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.999950:0:25802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3915f expref: 7 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851426.999996:0:25802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3915f expref: 7 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851427.000010:0:25802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:25802:1875746019880064:192.168.204.27@tcp:105: 00000100:00100000:1.0:1788851427.000121:0:25802:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851427.001829:0:25802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:25802:1875746019880064:192.168.204.27@tcp:105: 00010000:00010000:1.0:1788851427.001851:0:25802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851427.001898:0:25802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0844575f-19e7-4df3-8155-eb6a1666d628+7:2407:x1875746000900864:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 2051us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851427.001907:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:2.0:1788851427.005296:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851427.005703:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000900992 00000100:00100000:0.0:1788851427.005713:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000900992 00000100:00100000:0.0:1788851427.005797:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:0.0:1788851427.005809:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0844575f-19e7-4df3-8155-eb6a1666d628+7:2408:x1875746000900992:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788851427.005965:0:24278:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788851427.005970:0:24278:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788851425 00002000:00010000:0.0:1788851427.005973:0:24278:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788851424 00002000:00010000:0.0:1788851427.005989:0:24278:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788851426 -> 1788851425 00002000:00010000:0.0:1788851427.005992:0:24278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788851427.006096:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0844575f-19e7-4df3-8155-eb6a1666d628+8:2408:x1875746000900992:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 289us (811us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788851427.006104:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00080000:2.0:1788851427.006377:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851427.015895:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851427.015993:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000901120 00000100:00100000:1.0:1788851427.016003:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000901120 00000100:00100000:1.0:1788851427.016087:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:1.0:1788851427.016096:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+8:2409:x1875746000901120:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788851427.016138:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.016173:0:24281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3915f expref: 8 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.016181:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851427.016185:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851427.016189:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.016241:0:24281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3915f expref: 8 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.016255:0:24281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3915f expref: 8 pid: 24280 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851427.016269:0:24281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d87bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24281:1875746019880192:192.168.204.27@tcp:104: 00000100:00100000:1.0:1788851427.016354:0:24281:0:(client.c:2716:ptlrpc_set_wait()) set ffff892eb6ccdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851427.018936:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851427.019111:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000901248 00000100:00100000:2.0:1788851427.019120:0:22756:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000901248 00010000:00010000:2.0:1788851427.019160:0:22756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3915f expref: 9 pid: 24280 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851427.019202:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1788851427.019211:0:22756:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0844575f-19e7-4df3-8155-eb6a1666d628+9:2407:x1875746000901248:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851427.019225:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851427.019247:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3915f expref: 9 pid: 24280 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.019260:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3915f expref: 9 pid: 24280 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.019285:0:22756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851427.019302:0:22756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851427.019308:0:22756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.019318:0:22756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.019338:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851427.019385:0:22756:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5997480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0844575f-19e7-4df3-8155-eb6a1666d628+9:2407:x1875746000901248:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 175us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851427.019391:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00010000:00010000:1.0:1788851427.019753:0:24281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013cdc163/0x3e0030720b207aed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3915f expref: 8 pid: 24280 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851427.019769:0:24281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d87bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24281:1875746019880192:192.168.204.27@tcp:104: 00010000:00010000:1.0:1788851427.019789:0:24281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.019799:0:24281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.019807:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.019827:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.019848:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.019855:0:24281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.019862:0:24281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80031e00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:1.0:1788851427.019866:0:24281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.019875:0:24281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.019888:0:24281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.019895:0:24281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f042ff84/0x3e0030720b207af4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851427.019955:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+7:2409:x1875746000901120:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 3860us (4070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851427.019964:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:3.0:1788851427.024756:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851427.025608:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000901504 00000100:00100000:0.0:1788851427.025620:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000901504 00000100:00100000:2.0:1788851427.029658:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:2.0:1788851427.029689:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+16:18796:x1875746000901504:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788851427.029796:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.029815:0:22770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b207a45 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39120 expref: 16 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.029824:0:22770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.029865:0:22770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b207a45 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39120 expref: 16 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.029881:0:22770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b207a45 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39120 expref: 16 pid: 25721 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851427.029915:0:22770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb67ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22770:1875746019880320:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851427.030039:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81e13240 going to sleep for 11 seconds 00000100:00100000:3.0:1788851427.036999:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851427.037102:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000901632 00000100:00100000:0.0:1788851427.037112:0:22754:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000901632 00010000:00010000:0.0:1788851427.037151:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b207a45 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39120 expref: 17 pid: 25721 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851427.037251:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:0.0:1788851427.037261:0:22754:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0844575f-19e7-4df3-8155-eb6a1666d628+17:2407:x1875746000901632:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851427.037277:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851427.037284:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b207a45 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39120 expref: 17 pid: 25721 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.037296:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b207a45 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39120 expref: 17 pid: 25721 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.037319:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:0.0:1788851427.037325:0:22754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b207a61 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3912e expref: 17 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.037334:0:22754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.037361:0:22754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.037368:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.037387:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851427.037449:0:22754:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0844575f-19e7-4df3-8155-eb6a1666d628+17:2407:x1875746000901632:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 189us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851427.037457:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00010000:00010000:2.0:1788851427.037547:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa400/0x3e0030720b207a45 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39120 expref: 16 pid: 25721 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851427.037568:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb67ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22770:1875746019880320:192.168.204.27@tcp:104: 00010000:00010000:2.0:1788851427.037590:0:22770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.037599:0:22770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.037604:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.037826:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.037838:0:22770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7400/0x3e0030720b207aca lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3914a expref: 16 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.037845:0:22770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.037873:0:22770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7400/0x3e0030720b207aca lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3914a expref: 16 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.037885:0:22770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7400/0x3e0030720b207aca lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3914a expref: 16 pid: 22770 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851427.037911:0:22770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb67ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22770:1875746019880448:192.168.204.27@tcp:104: 00000100:00100000:2.0:1788851427.037959:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff892d81e130c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851427.040670:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb67ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22770:1875746019880448:192.168.204.27@tcp:104: 00010000:00010000:3.0:1788851427.040702:0:22770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851427.042487:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851427.042626:0:25802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000901760 00000100:00100000:1.0:1788851427.042635:0:25802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000901760 00010000:00010000:1.0:1788851427.042683:0:25802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7400/0x3e0030720b207aca lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3914a expref: 17 pid: 22770 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851427.042738:0:25802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:1.0:1788851427.042749:0:25802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5996300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0844575f-19e7-4df3-8155-eb6a1666d628+17:2407:x1875746000901760:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851427.042763:0:25802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851427.042770:0:25802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7400/0x3e0030720b207aca lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3914a expref: 17 pid: 22770 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.042783:0:25802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7400/0x3e0030720b207aca lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3914a expref: 17 pid: 22770 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.042805:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892d876e7400/0x3e0030720b207aca lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3914a expref: 17 pid: 22770 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.042820:0:25802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff892ea5408500) 00010000:00010000:1.0:1788851427.042825:0:25802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.042835:0:25802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.042842:0:25802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.042871:0:25802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851427.042921:0:25802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5996300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0844575f-19e7-4df3-8155-eb6a1666d628+16:2407:x1875746000901760:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 174us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851427.042928:0:25802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00010000:00010000:3.0:1788851427.043600:0:22770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851427.043621:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851427.043735:0:22770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1788851427.043849:0:22770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1788851427.043885:0:22770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1788851427.043964:0:22770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5994700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22770:1875746019880576:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788851427.044304:0:22770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851427.044337:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e8a58a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788851427.045140:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019880576 00000100:00100000:0.0:1788851427.045149:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019880576 00000100:00100000:0.0:1788851427.045196:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788851427.045204:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22770:x1875746019880576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788851427.045314:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22770:x1875746019880576:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851427.045322:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788851427.045539:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5994700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22770:1875746019880576:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788851427.045723:0:22770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1788851427.045782:0:22770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb67de680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22770:1875746019880704:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788851427.045817:0:22770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851427.045845:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff892ead2c90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851427.045975:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019880704 00000100:00100000:3.0:1788851427.045980:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019880704 00000100:00100000:3.0:1788851427.046035:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788851427.046042:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22770:x1875746019880704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788851427.046148:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22770:x1875746019880704:12345-0@lo:1000:mdt00_001.0 Request processed in 105us (329us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788851427.046155:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788851427.046361:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb67de680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22770:1875746019880704:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788851427.046394:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046404:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046411:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046417:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94800 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851427.046421:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046428:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046443:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff892ea5408500) 00010000:00010000:2.0:1788851427.046446:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851427.046450:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046468:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94800/0x3e0030720b207b02 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046497:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a5a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046518:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a5a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046524:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a5a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046529:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdab000 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851427.046531:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a5a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046537:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a5a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046549:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:2.0:1788851427.046552:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851427.046561:0:22770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b207a61 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3912e expref: 19 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046581:0:22770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b207a61 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3912e expref: 19 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046590:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b207a61 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3912e expref: 19 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.046649:0:22770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdaa800/0x3e0030720b207a61 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c3912e expref: 19 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851427.046660:0:22770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb67dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22770:1875746019880832:192.168.204.27@tcp:105: 00000100:00100000:2.0:1788851427.046724:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff892e88553780 going to sleep for 11 seconds 00000100:00100000:3.0:1788851427.050582:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851427.050819:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb67dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22770:1875746019880832:192.168.204.27@tcp:105: 00010000:00010000:2.0:1788851427.050846:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a5a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.050857:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebbdab000/0x3e0030720b207a5a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.050890:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b207b09 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.050903:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b207b09 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.050914:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b207b09 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.050926:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b207b09 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.050932:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b207b09 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.050939:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b207b09 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.050962:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff94c00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851427.050966:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b207b09 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.050974:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b207b09 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.050986:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:2.0:1788851427.050988:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851427.050992:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b207b09 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.050998:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff94c00/0x3e0030720b207b09 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.051008:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.051046:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.051053:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.051058:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95e00 already unused, calling callback (ffffffffc1a574f0) 00010000:00010000:2.0:1788851427.051062:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.051067:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.051088:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:2.0:1788851427.051090:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788851427.051093:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.051099:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95e00/0x3e0030720b207afb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851427.051256:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+19:18796:x1875746000901504:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 21583us (26509us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788851427.051267:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000020:00080000:2.0:1788851427.051274:0:22770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788851427.052326:0:22807:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788851427.052333:0:22807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788851427.052350:0:22807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788851427.052357:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788851427.053772:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1788851427.054243:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000901888 00000100:00100000:0.0:1788851427.054253:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000901888 00000100:00100000:1.0:1788851427.054307:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000902144 00000100:00100000:1.0:1788851427.054325:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000902144 00000100:00100000:1.0:1788851427.054367:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:1.0:1788851427.054377:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0844575f-19e7-4df3-8155-eb6a1666d628+20:18796:x1875746000902144:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788851427.054960:0:22772:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788851427.054993:0:22772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:1.0:1788851427.055228:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207b10 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.055245:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207b10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.055256:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207b10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.055265:0:22772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207b10 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.055271:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207b10 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.055277:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207b10 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.055333:0:22772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788851427.055430:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0844575f-19e7-4df3-8155-eb6a1666d628+22:18796:x1875746000902144:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 1053us (1663us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788851427.055449:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000020:00080000:1.0:1788851427.055454:0:22772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788851427.055470:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:1.0:1788851427.055478:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea5df5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0844575f-19e7-4df3-8155-eb6a1666d628+21:18795:x1875746000901888:12345-192.168.204.27@tcp:49:dd.0 00000100:00100000:1.0:1788851427.055568:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea5df5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0844575f-19e7-4df3-8155-eb6a1666d628+21:18795:x1875746000901888:12345-192.168.204.27@tcp:49:dd.0 Request processed in 91us (4996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851427.055575:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:1.0:1788851427.058915:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851427.059000:0:25721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000902272 00000100:00100000:2.0:1788851427.059038:0:25721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000902272 00000100:00100000:2.0:1788851427.059087:0:25721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:2.0:1788851427.059097:0:25721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+21:18795:x1875746000902272:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:2.0:1788851427.059117:0:25721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851427.059139:0:25721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b207b17 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd269f5ac56c39166 expref: -99 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.059174:0:25721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b207b1e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.059187:0:25721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b207b1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.059199:0:25721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b207b1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.059326:0:25721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95a00/0x3e0030720b207b17 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39166 expref: 23 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.059344:0:25721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff892ebff95000/0x3e0030720b207b1e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0xd269f5ac56c39166 expref: 22 pid: 25721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.059352:0:25721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff892e852d8d00) 00010000:00010000:2.0:1788851427.059354:0:25721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788851427.059358:0:25721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff892ebff95000, rc 0) 00000100:00100000:2.0:1788851427.059416:0:25721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0844575f-19e7-4df3-8155-eb6a1666d628+22:18795:x1875746000902272:12345-192.168.204.27@tcp:101:dd.0 Request processed in 321us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851427.059424:0:25721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00010000:00010000:0.0:1788851427.061899:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851427.061913:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207b10 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.061923:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892e80030c00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851427.061927:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207b10 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.061936:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207b10 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.061971:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff892ea5408500) 00010000:00010000:0.0:1788851427.061974:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788851427.061979:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207b10 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.061985:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff892e80030c00/0x3e0030720b207b10 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851427.062115:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851427.062118:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851427.062119:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851427.084359:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1788851427.084406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1788851427.084791:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000902528 00000100:00100000:2.0:1788851427.084801:0:24285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000902528 00000100:00100000:2.0:1788851427.084857:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000902400 00000100:00100000:2.0:1788851427.084860:0:24285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000902400 00000100:00100000:2.0:1788851427.084877:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:2.0:1788851427.084885:0:24285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0844575f-19e7-4df3-8155-eb6a1666d628+8:2407:x1875746000902528:12345-192.168.204.27@tcp:4:dd.0 00002000:00010000:2.0:1788851427.084930:0:24285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9fb4e1, atime: 0x6a9fb4e0, ctime: 0x6a9fb4e1, blocks: 0x0 00010000:00010000:2.0:1788851427.084938:0:24285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b207b25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.084954:0:24285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788851427.084959:0:24285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851427.084965:0:24285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b207b25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851427.084998:0:24285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b207b25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851427.154405:0:24275:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:2.0:1788851427.154422:0:24275:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1788851427.154648:0:24285:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1788851427.154653:0:24285:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788851425 -> 1788851426 00002000:00010000:0.0:1788851427.154656:0:24285:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788851425 -> 1788851426 00002000:00010000:0.0:1788851427.154658:0:24285:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1788851427.154687:0:24285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b207b25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.154700:0:24285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b207b25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.154710:0:24285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b207b25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.154718:0:24285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebff95a00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851427.154723:0:24285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b207b25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.154731:0:24285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b207b25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.155086:0:24285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b207b25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.155096:0:24285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000654d9865/0x3e0030720b207b25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851427.155207:0:24285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0844575f-19e7-4df3-8155-eb6a1666d628+6:2407:x1875746000902528:12345-192.168.204.27@tcp:4:dd.0 Request processed in 70317us (70852us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788851427.155222:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1788851427.155253:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:0.0:1788851427.155264:0:24285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0844575f-19e7-4df3-8155-eb6a1666d628+5:2407:x1875746000902400:12345-192.168.204.27@tcp:4:dd.0 00002000:00010000:0.0:1788851427.155303:0:24285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 7654321, mtime: 0x6a9fb4e2, atime: 0x6a9fb4e0, ctime: 0x6a9fb4e2, blocks: 0x1a68 00010000:00010000:0.0:1788851427.155309:0:24285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029999b5d/0x3e0030720b207b2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.155321:0:24285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=761s v=(0 0) 00010000:00010000:0.0:1788851427.155325:0:24285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851427.155330:0:24285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029999b5d/0x3e0030720b207b2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.155343:0:24285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029999b5d/0x3e0030720b207b2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851427.253098:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb67dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019880960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788851427.253168:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851427.253687:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019880960 00000100:00100000:0.0:1788851427.253696:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019880960 00000100:00100000:0.0:1788851427.253781:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788851427.253782:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851427.253790:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892ea74e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019880960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788851427.253813:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 30543552 pending 4218880 free 3923505152 avail 3688497152 00000100:00100000:0.0:1788851427.253870:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019880960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851427.253877:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788851427.254057:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb67dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019880960:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1788851427.278661:0:24275:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:0.0:1788851427.279072:0:24285:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1788851427.279093:0:24285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029999b5d/0x3e0030720b207b2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.279106:0:24285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029999b5d/0x3e0030720b207b2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.279116:0:24285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029999b5d/0x3e0030720b207b2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.279123:0:24285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff892ebbdaac00 already unused, calling callback (ffffffffc0e108b0) 00010000:00010000:0.0:1788851427.279128:0:24285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029999b5d/0x3e0030720b207b2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.279138:0:24285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029999b5d/0x3e0030720b207b2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.279159:0:24285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029999b5d/0x3e0030720b207b2c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851427.279167:0:24285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029999b5d/0x3e0030720b207b2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851427.279289:0:24285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892ea74e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0844575f-19e7-4df3-8155-eb6a1666d628+5:2407:x1875746000902400:12345-192.168.204.27@tcp:4:dd.0 Request processed in 124023us (194877us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788851427.279299:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00010000:00010000:3.0:1788851427.444286:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851428.276403:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019881472:0@lo:400:kworker.0 00000100:00100000:3.0:1788851428.276499:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851428.276534:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d85690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019881984:0@lo:400:kworker.0 00000100:00100000:3.0:1788851428.276553:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851428.276572:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d85691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019882496:0@lo:400:kworker.0 00000100:00100000:3.0:1788851428.276593:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851428.276614:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788851428.276620:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3647:1875746019881088:0@lo:400:kworker.0 00000100:00100000:3.0:1788851428.276984:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851428.277062:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d85690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019881600:0@lo:400:kworker.0 00000100:00100000:3.0:1788851428.277089:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851428.277104:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d85693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019882112:0@lo:400:kworker.0 00000100:00100000:3.0:1788851428.277121:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851428.277134:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d85692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019882624:0@lo:400:kworker.0 00000100:00100000:3.0:1788851428.277152:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851428.277182:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019881472 00000100:00100000:3.0:1788851428.277190:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019881472 00000100:00100000:3.0:1788851428.277239:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019881984 00000100:00100000:3.0:1788851428.277254:0:24278:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019881984 00000100:00100000:0.0:1788851428.277368:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019882496 00000100:00100000:0.0:1788851428.277373:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019882496 00000100:00100000:0.0:1788851428.277398:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019881600 00000100:00100000:0.0:1788851428.277400:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019881600 00000100:00100000:0.0:1788851428.277411:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019882112 00000100:00100000:0.0:1788851428.277413:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019882112 00000100:00100000:0.0:1788851428.277423:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019882624 00000100:00100000:0.0:1788851428.277425:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019882624 00000100:00100000:0.0:1788851428.277437:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788851428.277447:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d85691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019882496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851428.277511:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d85691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875746019882496:12345-0@lo:400:kworker.0 Request processed in 66us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851428.277519:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788851428.277535:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788851428.277541:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d85692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019881600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851428.277568:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d85692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875746019881600:12345-0@lo:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851428.277574:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788851428.277586:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788851428.277592:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d85691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019882112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851428.277617:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d85691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875746019882112:12345-0@lo:400:kworker.0 Request processed in 25us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851428.277623:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788851428.277648:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788851428.277654:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d85693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019882624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851428.277681:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d85693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875746019882624:12345-0@lo:400:kworker.0 Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851428.277682:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019881216:0@lo:400:kworker.0 00000100:00100000:0.0:1788851428.277687:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788851428.277713:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851428.277733:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d85692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019881728:0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.277760:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851428.277779:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d85691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019882240:0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.277800:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851428.277818:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788851428.277824:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea74e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019881344:0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.277846:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851428.277856:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d85693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019881856:0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.277890:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851428.277901:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892d85690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019882368:0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.277919:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851428.277986:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019882240 00000100:00100000:2.0:1788851428.277990:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019882240 00000100:00100000:2.0:1788851428.278034:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019882368 00000100:00100000:2.0:1788851428.278037:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019882368 00000100:00100000:2.0:1788851428.278055:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788851428.278061:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019882240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.278098:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875746019882240:12345-0@lo:400:kworker.0 Request processed in 38us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851428.278104:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788851428.278117:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788851428.278122:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019882368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.278146:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875746019882368:12345-0@lo:400:kworker.0 Request processed in 24us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851428.278151:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788851428.278171:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788851428.278175:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851428.278178:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851428.278186:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019881216 00000100:00100000:2.0:1788851428.278190:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019881216 00000100:00100000:2.0:1788851428.278215:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019881728 00000100:00100000:2.0:1788851428.278218:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019881728 00000100:00100000:2.0:1788851428.278229:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788851428.278234:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019881216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.278265:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019881216:12345-0@lo:400:kworker.0 Request processed in 30us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851428.278270:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788851428.278294:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788851428.278301:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019881728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.278325:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019881728:12345-0@lo:400:kworker.0 Request processed in 26us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851428.278332:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788851428.278354:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb67dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019882880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788851428.278390:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851428.278407:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788851428.278426:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb67dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019882752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851428.278449:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851428.278490:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019882752 00000100:00100000:2.0:1788851428.278494:0:24282:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019882752 00000100:00100000:2.0:1788851428.278522:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788851428.278528:0:24282:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019882752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851428.278548:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788851428.278583:0:24282:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875746019882752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851428.278589:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788851428.278631:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb67dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019882752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851428.278651:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019882880 00000100:00100000:2.0:1788851428.278654:0:22775:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019882880 00000100:00100000:2.0:1788851428.278673:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788851428.278679:0:22775:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019882880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788851428.278700:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788851428.278731:0:22775:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875746019882880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851428.278737:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788851428.278766:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb67dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875746019882880:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788851428.278789:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d85690380 x1875746019882368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851428.278800:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d85690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875746019882368:0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.278821:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019881216:0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.278829:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d85692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019881728:0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.278837:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d85691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875746019882240:0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.278896:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851428.278904:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892eb67dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019883008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788851428.278927:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851428.278950:0:23778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019883008 00000100:00100000:2.0:1788851428.278953:0:23778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019883008 00000100:00100000:2.0:1788851428.278973:0:23778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788851428.278979:0:23778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019883008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788851428.278995:0:23778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788851428.279048:0:23778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019883008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851428.279054:0:23778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788851428.279081:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892eb67dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019883008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788851428.279116:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d85690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875746019881600:0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.279126:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d85693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875746019882112:0@lo:400:kworker.0 00010000:00080000:2.0:1788851428.279136:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff892d85692680 x1875746019882624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851428.279144:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d85692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875746019882624:0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.279154:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d85691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875746019882496:0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.279197:0:24765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019881344 00000100:00100000:2.0:1788851428.279225:0:24765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019881344 00000100:00100000:3.0:1788851428.280735:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788851428.280757:0:24278:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d85690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019881472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851428.280844:0:24278:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d85690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875746019881472:12345-0@lo:400:kworker.0 Request processed in 97us (4344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851428.283074:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788851428.283098:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d85690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019881984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851428.283178:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d85690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875746019881984:12345-0@lo:400:kworker.0 Request processed in 92us (6622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851428.283186:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788851428.283216:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019881856 00000100:00100000:0.0:1788851428.283224:0:24280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019881856 00000100:00100000:0.0:1788851428.283337:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788851428.283345:0:24280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019881856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851428.283392:0:24280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875746019881856:12345-0@lo:400:kworker.0 Request processed in 48us (5501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851428.283399:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788851428.283451:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d85693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875746019881856:0@lo:400:kworker.0 00000100:00100000:0.0:1788851428.283668:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019881088 00000100:00100000:0.0:1788851428.283672:0:22764:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019881088 00000100:00100000:0.0:1788851428.283703:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788851428.283710:0:22764:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d8906bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:3647:x1875746019881088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851428.283744:0:22764:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d8906bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4a524f-5762-4d21-be7e-dbb6f41ca491+24:3647:x1875746019881088:12345-0@lo:400:kworker.0 Request processed in 35us (6761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851428.283751:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788851428.283782:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019883264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851428.283960:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788851428.284038:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851428.284051:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff892ea5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019883136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851428.284078:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851428.284131:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc4a524f-5762-4d21-be7e-dbb6f41ca491:3647:1875746019881088:0@lo:400:kworker.0 00000100:00100000:0.0:1788851428.284146:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875746019881472:0@lo:400:kworker.0 00000100:00100000:0.0:1788851428.284155:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892d85690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875746019881984:0@lo:400:kworker.0 00000100:00100000:0.0:1788851428.284206:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019883264 00000100:00100000:0.0:1788851428.284210:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019883264 00000100:00100000:0.0:1788851428.284228:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019883136 00000100:00100000:0.0:1788851428.284231:0:24283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019883136 00000100:00100000:0.0:1788851428.284329:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788851428.284336:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019883264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788851428.284351:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:0.0:1788851428.284388:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875746019883264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851428.284394:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788851428.284408:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788851428.284414:0:24283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019883136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788851428.284424:0:24283:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788851428.284455:0:24283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875746019883136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851428.284461:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788851428.284568:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875746019883136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788851428.284596:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1788851428.284609:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff892e83e16300, transno 12884901892 00000004:00080000:0.0:1788851428.284620:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1788851428.284653:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019883264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851428.285233:0:24765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788851428.285569:0:24765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb67df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019881344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851428.285630:0:24765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb67df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875746019881344:12345-0@lo:400:kworker.0 Request processed in 70us (7783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851428.285638:0:24765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788851428.285714:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff892ea74e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875746019881344:0@lo:400:kworker.0 00000100:00100000:3.0:1788851428.286370:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788851428.469258:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788851428.974640:0:25857:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788851429.493601:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851430.133130:0:22807:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788851430.133139:0:22807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788851430.133157:0:22807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788851430.133164:0:22807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788851430.519782:0:25110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851430.685500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851430.685551:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851430.685581:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851430.685605:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851430.685627:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851430.685646:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851430.685666:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851430.685685:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851430.685707:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1788851430.685745:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000902784 00000100:00100000:1.0:1788851430.685754:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000902784 00000100:00100000:1.0:1788851430.685808:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000902912 00000100:00100000:1.0:1788851430.685812:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000902912 00000100:00100000:1.0:1788851430.685952:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000903296 00000100:00100000:1.0:1788851430.685956:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000903296 00000100:00100000:1.0:1788851430.685970:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000903424 00000100:00100000:1.0:1788851430.685973:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000903424 00000100:00100000:1.0:1788851430.685988:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:1.0:1788851430.685997:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d87bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+22:2407:x1875746000902784:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851430.686096:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d87bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+22:2407:x1875746000902784:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 99us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851430.686116:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:1.0:1788851430.686134:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:1.0:1788851430.686143:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892eb694e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+5:2408:x1875746000902912:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851430.686171:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892eb694e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0844575f-19e7-4df3-8155-eb6a1666d628+5:2408:x1875746000902912:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 31us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851430.686177:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:1.0:1788851430.686188:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:1.0:1788851430.686194:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+6:2407:x1875746000903296:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851430.686218:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+6:2407:x1875746000903296:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851430.686225:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:1.0:1788851430.686236:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:1.0:1788851430.686242:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e87079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2408:x1875746000903424:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851430.686263:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e87079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2408:x1875746000903424:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851430.686268:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 65 00000100:00100000:1.0:1788851430.686289:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000903040 00000100:00100000:1.0:1788851430.686293:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000903040 00000100:00100000:1.0:1788851430.686310:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000903168 00000100:00100000:1.0:1788851430.686313:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000903168 00000100:00100000:1.0:1788851430.686323:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000903552 00000100:00100000:1.0:1788851430.686325:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000903552 00000100:00100000:1.0:1788851430.686335:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000903680 00000100:00100000:1.0:1788851430.686338:0:24281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000903680 00000100:00100000:1.0:1788851430.686351:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1788851430.686364:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:2407:x1875746000903040:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851430.686395:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:2407:x1875746000903040:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 32us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851430.686400:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:1.0:1788851430.686412:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:1.0:1788851430.686418:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:2408:x1875746000903168:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851430.686452:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0844575f-19e7-4df3-8155-eb6a1666d628+5:2408:x1875746000903168:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 34us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851430.686459:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:1.0:1788851430.686471:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:1.0:1788851430.686477:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e8707a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2407:x1875746000903552:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851430.686499:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e8707a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2407:x1875746000903552:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851430.686505:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:1.0:1788851430.686516:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:1.0:1788851430.686522:0:24281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892e85696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2408:x1875746000903680:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1788851430.686542:0:24281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892e85696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b140db83-9b09-493c-aeff-0cdb002e3e74+5:2408:x1875746000903680:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851430.686548:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00080000:1.0:1788851430.686575:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851430.686579:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851430.686581:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788851430.686583:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851430.688989:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000902656 00000100:00100000:2.0:1788851430.689002:0:22761:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000902656 00000100:00100000:2.0:1788851430.689084:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:2.0:1788851430.689094:0:22761:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff892d89069c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:2408:x1875746000902656:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1788851430.689163:0:22761:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff892d89069c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b9bae48-b8e9-4e3e-9ed0-aef69e92cdc5+13:2408:x1875746000902656:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 70us (3672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851430.689170:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 167 Debug log: 13972 lines, 13972 kept, 0 dropped, 0 bad.