00010000:00010000:0.0F:1787384705.402300:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384706.422943:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384706.487941:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203431296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384706.488009:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384706.488083:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203431296 00000100:00100000:0.0:1787384706.488102:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203431296 00000100:00100000:0.0:1787384706.488162:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787384706.488170:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203431296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384706.488201:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384706.488242:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203431296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384706.488249:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787384706.488298:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203431296:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0F:1787384706.488851:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0F:1787384707.001330:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1787384707.001367:0:17130:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f8d8293e40 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:3.0:1787384707.001373:0:17130:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f8ee5dc000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f8cb364480 00000020:00080000:3.0:1787384707.001376:0:17130:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f8ee5dc500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f8f0fb0400 00010000:00010000:1.0:1787384707.001444:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4145 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384707.001457:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4145 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384707.001464:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4145 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384707.001471:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384707.001475:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4145 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384707.001482:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4145 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384707.001501:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:1.0:1787384707.001504:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384707.001509:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4145 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384707.001515:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4145 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787384707.002874:0:17190:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:1.0:1787384707.002958:0:17190:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1787384707.447094:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384707.510995:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203431424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384707.511062:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384707.511129:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203431424 00000100:00100000:0.0:1787384707.511137:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203431424 00000100:00100000:0.0:1787384707.511184:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787384707.511193:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203431424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384707.511220:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787384707.511264:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203431424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384707.511271:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787384707.511290:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384707.511321:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203431424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384707.512013:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203431680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384707.512051:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384707.512236:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203431680 00000100:00100000:0.0:1787384707.512242:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203431680 00000100:00100000:0.0:1787384707.512303:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787384707.512312:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203431680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787384707.512325:0:19944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384707.512372:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203431680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384707.512379:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787384707.512401:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203431552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384707.512426:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384707.512452:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203431552 00000100:00100000:0.0:1787384707.512456:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203431552 00000100:00100000:0.0:1787384707.512480:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787384707.512486:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203431552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384707.512497:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787384707.512527:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203431552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384707.512533:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787384707.512559:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1787384707.512564:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f7c20d3100, transno 8589934596 00000004:00080000:0.0:1787384707.512576:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1787384707.512601:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0fd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203431552:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787384707.512760:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384707.512764:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384707.512990:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203431680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384707.514276:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203431808:0@lo:400:kworker.0 00000100:00100000:1.0:1787384707.514338:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384707.514406:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203431808 00000100:00100000:3.0:1787384707.514412:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203431808 00000100:00100000:3.0:1787384707.514451:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787384707.514459:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+24:3652:x1874208203431808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384707.515386:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+24:3652:x1874208203431808:12345-0@lo:400:kworker.0 Request processed in 925us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384707.515395:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787384707.518411:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203432192:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.518471:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384707.518512:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203432704:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.518534:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384707.518559:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787384707.518565:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203432320:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.518599:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384707.518617:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203432832:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.518637:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384707.518666:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203432192 00000100:00100000:0.0:1787384707.518673:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203432192 00000100:00100000:0.0:1787384707.518714:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203432704 00000100:00100000:0.0:1787384707.518718:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203432704 00000100:00100000:0.0:1787384707.518739:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203432832 00000100:00100000:0.0:1787384707.518741:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203432832 00000100:00100000:0.0:1787384707.518755:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787384707.518763:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203432192:12345-0@lo:400:kworker.0 00000100:00100000:2.0F:1787384707.519599:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787384707.519618:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203432704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384707.519680:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203432704:12345-0@lo:400:kworker.0 Request processed in 65us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384707.519687:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787384707.519710:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787384707.519717:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203432832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384707.519746:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203432832:12345-0@lo:400:kworker.0 Request processed in 29us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384707.519751:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787384707.520077:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203432192:12345-0@lo:400:kworker.0 Request processed in 1313us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384707.520084:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787384707.520109:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203432320 00000100:00100000:0.0:1787384707.520114:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203432320 00000100:00100000:0.0:1787384707.520143:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787384707.520150:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203432320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.520183:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203432320:12345-0@lo:400:kworker.0 Request processed in 34us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384707.520190:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787384707.520214:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384707.520218:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384707.520230:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203432064:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.520258:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384707.520287:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203432576:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.520307:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384707.520335:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787384707.520342:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203431936:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.520363:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384707.520377:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203432448:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.520395:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384707.520407:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203432960:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.520422:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384707.520440:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203431936 00000100:00100000:0.0:1787384707.520444:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203431936 00000100:00100000:0.0:1787384707.520465:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787384707.520471:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203431936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.520502:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203431936:12345-0@lo:400:kworker.0 Request processed in 31us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384707.520508:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787384707.520524:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203432576 00000100:00100000:0.0:1787384707.520527:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203432576 00000100:00100000:0.0:1787384707.520551:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203432448 00000100:00100000:0.0:1787384707.520553:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203432448 00000100:00100000:0.0:1787384707.520564:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203432960 00000100:00100000:0.0:1787384707.520565:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203432960 00000100:00100000:0.0:1787384707.520577:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787384707.520582:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203432576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.520607:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203432576:12345-0@lo:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384707.520612:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787384707.520622:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787384707.520626:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203432448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.520656:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203432448:12345-0@lo:400:kworker.0 Request processed in 30us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384707.520662:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787384707.520673:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787384707.520679:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203432960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.520702:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203432960:12345-0@lo:400:kworker.0 Request processed in 23us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384707.520707:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787384707.520722:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384707.520724:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384707.520748:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203431936:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.520760:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203432448:0@lo:400:kworker.0 00010000:00080000:0.0:1787384707.520770:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee114a80 x1874208203432960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384707.520810:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203432960:0@lo:400:kworker.0 00000100:00100000:1.0:1787384707.520933:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203431808:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.521046:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203432576:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.521080:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203432320:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.521090:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203432832:0@lo:400:kworker.0 00000100:00100000:0.0:1787384707.521100:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203432192:0@lo:400:kworker.0 00010000:00080000:0.0:1787384707.521111:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee116d80 x1874208203432704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384707.521120:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203432704:0@lo:400:kworker.0 00000100:00100000:3.0:1787384707.521292:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203432064 00000100:00100000:3.0:1787384707.521297:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203432064 00000100:00100000:3.0:1787384707.521353:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787384707.521361:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203432064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384707.521404:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203432064:12345-0@lo:400:kworker.0 Request processed in 44us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384707.521409:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787384707.521515:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203432064:0@lo:400:kworker.0 00000100:00100000:1.0:1787384707.876524:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384707.877271:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182386560 00000100:00100000:2.0:1787384707.877280:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182386560 00000100:00100000:2.0:1787384707.877360:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 74 00000100:00100000:2.0:1787384707.877370:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+12:15596:x1874208182386560:12345-192.168.203.45@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787384707.877471:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+12:15596:x1874208182386560:12345-192.168.203.45@tcp:60:lhsmtool_posix.0 Request processed in 101us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384707.877478:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 74 00000100:00080000:1.0:1787384707.878436:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384707.882643:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384707.882805:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182386688 00000100:00100000:0.0:1787384707.882822:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182386688 00000100:00100000:0.0:1787384707.882883:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 75 00000100:00100000:0.0:1787384707.882893:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+5:15596:x1874208182386688:12345-192.168.203.45@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787384707.882984:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+5:15596:x1874208182386688:12345-192.168.203.45@tcp:60:lhsmtool_posix.0 Request processed in 92us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384707.882992:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 75 00000100:00080000:3.0:1787384707.883310:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384707.906463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384707.908773:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182386944 00000100:00100000:0.0:1787384707.908822:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182386944 00000100:00100000:0.0:1787384707.908888:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:0.0:1787384707.908899:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb76c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+12:15596:x1874208182386944:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787384707.909162:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb76c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+13:15596:x1874208182386944:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 263us (2704us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1787384707.909171:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:2.0:1787384708.023103:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384708.023127:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203433088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384708.023197:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384708.023445:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203433088 00000100:00100000:3.0:1787384708.023453:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203433088 00000100:00100000:3.0:1787384708.023545:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787384708.023566:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203433088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384708.023606:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787384708.023661:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203433088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384708.023668:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787384708.023984:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203433088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384708.024586:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384708.024596:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203433216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384708.024631:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384708.030001:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203433216 00000100:00100000:1.0:1787384708.030016:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203433216 00000100:00100000:0.0:1787384708.030116:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787384708.030128:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203433216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787384708.030164:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787384708.030328:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203433216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 201us (5694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384708.030337:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787384708.033564:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203433216:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787384708.214993:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787384708.215003:0:17184:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787384708.215032:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787384708.215041:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787384708.472284:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384709.495819:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384709.985162:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384709.985209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384709.985240:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384709.985266:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384709.985289:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384709.985311:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384709.985336:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182387328 00000100:00100000:3.0:1787384709.985344:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182387328 00000100:00100000:2.0:1787384709.985549:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182387584 00000100:00100000:2.0:1787384709.985565:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182387584 00000100:00100000:2.0:1787384709.985609:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182387200 00000100:00100000:2.0:1787384709.985611:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182387200 00000100:00100000:2.0:1787384709.985621:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182387712 00000100:00100000:2.0:1787384709.985623:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182387712 00000100:00100000:1.0:1787384709.985674:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182387072 00000100:00100000:1.0:1787384709.985677:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182387072 00000100:00100000:1.0:1787384709.985715:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 171 00000100:00100000:1.0:1787384709.985724:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+13:2414:x1874208182387072:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384709.985819:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+13:2414:x1874208182387072:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 95us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384709.985826:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 171 00000100:00080000:1.0:1787384709.985967:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384709.985980:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 84 00000100:00100000:1.0:1787384709.985988:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2414:x1874208182387584:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384709.986023:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2414:x1874208182387584:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 36us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384709.986029:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 84 00000100:00100000:1.0:1787384709.986046:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 85 00000100:00100000:1.0:1787384709.986052:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+13:2414:x1874208182387200:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384709.986082:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+13:2414:x1874208182387200:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 30us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384709.986088:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 85 00000100:00100000:1.0:1787384709.986128:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182387456 00000100:00100000:1.0:1787384709.986132:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182387456 00000100:00100000:1.0:1787384709.986165:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:1.0:1787384709.986171:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2414:x1874208182387456:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384709.986199:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2414:x1874208182387456:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 28us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384709.986205:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00080000:1.0:1787384709.986219:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384709.986743:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 86 00000100:00080000:1.0:1787384709.986808:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384709.991270:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 87 00000100:00100000:2.0:1787384709.991288:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2414:x1874208182387712:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384709.991405:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2414:x1874208182387712:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 121us (6092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384709.991414:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 87 00000100:00100000:3.0:1787384709.992825:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2414:x1874208182387328:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384709.992925:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2414:x1874208182387328:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 6173us (7714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384709.992941:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 86 00010000:00010000:1.0:1787384710.520497:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787384711.098056:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 00000020:00000080:3.0:1787384711.098066:0:19472:0:(genops.c:906:class_export_put()) final put ffff98f7c40d0000/bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 00000020:00000080:1.0:1787384711.098185:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c40d0000/bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 for lustre-OST0001 00000020:00000080:1.0:1787384711.098247:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c40d4800 for lustre-OST0001 00000001:00100000:0.0:1787384711.098312:0:18652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 00000020:00000080:0.0:1787384711.098317:0:18652:0:(genops.c:906:class_export_put()) final put ffff98f7c222a800/bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 00000001:00100000:0.0:1787384711.098333:0:18652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8741dc33-c445-439b-a6e3-d8ded553bb00 00000020:00000080:0.0:1787384711.098336:0:18652:0:(genops.c:906:class_export_put()) final put ffff98f7c236c800/8741dc33-c445-439b-a6e3-d8ded553bb00 00000020:00000080:2.0:1787384711.098348:0:16239:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c222a800/bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 for lustre-OST0000 00000020:00000080:2.0:1787384711.098381:0:16239:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c236c800/8741dc33-c445-439b-a6e3-d8ded553bb00 for lustre-OST0000 00000020:00000080:2.0:1787384711.098398:0:16239:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c222a000 for lustre-OST0000 00000020:00000080:2.0:1787384711.098402:0:16239:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c2369000 for lustre-OST0000 00010000:00010000:0.0:1787384711.543098:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384711.606984:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384711.607007:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203433344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384711.607087:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384711.607397:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203433344 00000100:00100000:0.0:1787384711.607405:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203433344 00000100:00100000:0.0:1787384711.607478:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787384711.607488:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203433344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384711.607517:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384711.607574:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203433344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384711.607580:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787384711.607662:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203433344:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787384711.608023:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787384712.577112:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384712.630931:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384712.630956:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203433600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384712.631025:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384712.631132:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203433984:0@lo:400:kworker.0 00000100:00100000:2.0:1787384712.632068:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384712.632094:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203434496:0@lo:400:kworker.0 00000100:00100000:0.0:1787384712.632095:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203433472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384712.632121:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384712.632122:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384712.632138:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203435008:0@lo:400:kworker.0 00000100:00100000:0.0:1787384712.632138:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203434112:0@lo:400:kworker.0 00000100:00100000:0.0:1787384712.632156:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384712.632157:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384712.632170:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203434624:0@lo:400:kworker.0 00000100:00100000:0.0:1787384712.632190:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384712.632226:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203433856:0@lo:400:kworker.0 00000100:00100000:1.0:1787384712.632259:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384712.632286:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203434368:0@lo:400:kworker.0 00000100:00100000:1.0:1787384712.632306:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384712.632321:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203434880:0@lo:400:kworker.0 00000100:00100000:3.0:1787384712.632322:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203433728:0@lo:400:kworker.0 00000100:00100000:1.0:1787384712.632347:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203433984 00000100:00100000:1.0:1787384712.632353:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203433984 00000100:00100000:3.0:1787384712.632359:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384712.632381:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203434240:0@lo:400:kworker.0 00000100:00100000:1.0:1787384712.632392:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203434496 00000100:00100000:1.0:1787384712.632395:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203434496 00000100:00100000:1.0:1787384712.632415:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203434112 00000100:00100000:1.0:1787384712.632418:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203434112 00000100:00100000:1.0:1787384712.632433:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384712.632536:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203433984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384712.632592:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203433984:12345-0@lo:400:kworker.0 Request processed in 60us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384712.632991:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203435136:0@lo:400:kworker.0 00000100:00100000:0.0:1787384712.633016:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384712.633038:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203435008 00000100:00100000:2.0:1787384712.633042:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203435008 00000100:00100000:2.0:1787384712.633076:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203434624 00000100:00100000:2.0:1787384712.633079:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203434624 00000100:00100000:2.0:1787384712.633107:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787384712.633113:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787384712.633113:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203435008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384712.633120:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203434496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384712.633148:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203434496:12345-0@lo:400:kworker.0 Request processed in 28us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384712.633148:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203435008:12345-0@lo:400:kworker.0 Request processed in 34us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384712.633155:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787384712.633155:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787384712.633172:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787384712.633172:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787384712.633178:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203434112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384712.633178:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203434624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384712.633204:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203434624:12345-0@lo:400:kworker.0 Request processed in 26us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384712.633210:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787384712.633261:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787384712.633287:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384712.633292:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384712.633294:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384712.633327:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203433984:0@lo:400:kworker.0 00000100:00100000:1.0:1787384712.633338:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203434496:0@lo:400:kworker.0 00000100:00100000:1.0:1787384712.633347:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203435008:0@lo:400:kworker.0 00000100:00100000:2.0:1787384712.633399:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203435136 00000100:00100000:0.0:1787384712.633401:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203434624:0@lo:400:kworker.0 00000100:00100000:2.0:1787384712.633402:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203435136 00000100:00100000:0.0:1787384712.633423:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203433600 00000100:00100000:2.0:1787384712.633426:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787384712.633426:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203433600 00000100:00100000:2.0:1787384712.633432:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203435136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384712.633460:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203433472 00000100:00100000:0.0:1787384712.633464:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203433472 00000100:00100000:2.0:1787384712.633479:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203435136:12345-0@lo:400:kworker.0 Request processed in 47us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384712.633485:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787384712.633485:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787384712.633490:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203433600:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384712.633501:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787384712.633507:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874208203433472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384712.633512:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00002000:00000024:2.0:1787384712.633514:0:19944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787384712.633540:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874208203433472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384712.633545:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787384712.633551:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203433600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (2527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384712.633557:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787384712.633579:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203433472:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787384712.633591:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35d8e00 x1874208203435136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384712.633608:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203435136:0@lo:400:kworker.0 00000100:00100000:2.0:1787384712.633624:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203433600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384712.633850:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203433728 00000100:00100000:2.0:1787384712.633854:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203433728 00000100:00100000:2.0:1787384712.633887:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787384712.633893:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:3651:x1874208203433728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384712.633926:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:3651:x1874208203433728:12345-0@lo:400:kworker.0 Request processed in 33us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384712.633932:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787384712.633960:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203433856 00000100:00100000:2.0:1787384712.633964:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203433856 00000100:00100000:2.0:1787384712.633980:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203434368 00000100:00100000:2.0:1787384712.633983:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203434368 00000100:00100000:2.0:1787384712.633994:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787384712.634000:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203433856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384712.634030:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203433856:12345-0@lo:400:kworker.0 Request processed in 30us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384712.634036:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787384712.634045:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787384712.634050:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203434368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384712.634072:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203434368:12345-0@lo:400:kworker.0 Request processed in 22us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384712.634077:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787384712.634144:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203434112:12345-0@lo:400:kworker.0 Request processed in 965us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384712.634151:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787384712.634176:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384712.634209:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203434752:0@lo:400:kworker.0 00000100:00100000:2.0:1787384712.634210:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203434112:0@lo:400:kworker.0 00000100:00100000:3.0:1787384712.634235:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384712.634253:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203434240 00000100:00100000:3.0:1787384712.634255:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203435264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384712.634256:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203434240 00000100:00100000:2.0:1787384712.634275:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203434752 00000100:00100000:3.0:1787384712.634277:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384712.634278:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203434752 00000100:00100000:2.0:1787384712.634295:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787384712.634298:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203433728:0@lo:400:kworker.0 00000100:00100000:2.0:1787384712.634300:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203434240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384712.634319:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787384712.634326:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203434752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384712.634332:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203434240:12345-0@lo:400:kworker.0 Request processed in 32us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384712.634337:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787384712.634352:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203434752:12345-0@lo:400:kworker.0 Request processed in 27us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384712.634358:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787384712.634377:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203435264 00000100:00100000:3.0:1787384712.634387:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203435264 00000100:00100000:3.0:1787384712.634422:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384712.634428:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203435264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384712.634439:0:19944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787384712.634466:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203435264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384712.634472:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384712.634500:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203435264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384712.634510:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203434240:0@lo:400:kworker.0 00000100:00100000:3.0:1787384712.634517:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203434752:0@lo:400:kworker.0 00000001:00080000:3.0:1787384712.636107:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:3.0:1787384712.636121:0:17130:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000100:00080000:1.0:1787384712.636894:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384712.636900:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384712.636904:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384712.636921:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384712.636973:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203434880 00000100:00100000:3.0:1787384712.636982:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203434880 00000100:00100000:1.0:1787384712.637001:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203433856:0@lo:400:kworker.0 00000100:00100000:1.0:1787384712.637017:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203434368:0@lo:400:kworker.0 00000100:00100000:3.0:1787384712.637043:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1787384712.637047:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384712.637056:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203434880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384712.637175:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203434880:12345-0@lo:400:kworker.0 Request processed in 123us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384712.637183:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1787384712.637219:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8cb124700 x1874208203434880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384712.637231:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203434880:0@lo:400:kworker.0 00000020:00080000:2.0:1787384712.637736:0:17190:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:2.0:1787384712.637748:0:17190:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000001:02000400:3.0:1787384712.950218:0:20527:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 03:45:10 (1787384710) 00000040:00080000:3.0:1787384713.020037:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787384713.143451:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384713.143474:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203435392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384713.143538:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384713.144553:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203435392 00000100:00100000:2.0:1787384713.144562:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203435392 00000100:00100000:2.0:1787384713.144618:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787384713.144627:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203435392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384713.144661:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787384713.144721:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203435392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384713.144729:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787384713.144796:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203435392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384713.148690:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384713.148712:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203435520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384713.148813:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384713.148900:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203435520 00000100:00100000:1.0:1787384713.148907:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203435520 00000100:00100000:1.0:1787384713.148968:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787384713.148978:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203435520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384713.149015:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384713.149080:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203435520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384713.149107:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787384713.149335:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0fd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203435520:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787384713.590952:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384714.619308:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384715.117296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384715.117378:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182387840 00000100:00100000:3.0:1787384715.117388:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182387840 00000100:00100000:3.0:1787384715.117446:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 173 00000100:00100000:3.0:1787384715.117456:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+13:2414:x1874208182387840:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384715.117541:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+13:2414:x1874208182387840:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 85us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384715.117549:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 173 00000100:00100000:1.0:1787384715.123214:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384715.123252:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384715.123331:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384715.123364:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182388224 00000100:00100000:1.0:1787384715.123373:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182388224 00000100:00100000:1.0:1787384715.123432:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:1.0:1787384715.123442:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2413:x1874208182388224:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384715.123512:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2413:x1874208182388224:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 72us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384715.123519:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00080000:1.0:1787384715.123538:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384715.123766:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182387968 00000100:00100000:2.0:1787384715.123771:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182387968 00000100:00100000:2.0:1787384715.123841:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182388096 00000100:00100000:2.0:1787384715.123844:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182388096 00000100:00100000:2.0:1787384715.123863:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 94 00000100:00100000:2.0:1787384715.123881:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+12:2413:x1874208182387968:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384715.123943:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+12:2413:x1874208182387968:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 63us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384715.123949:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 94 00000100:00100000:2.0:1787384715.123963:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 95 00000100:00100000:2.0:1787384715.123969:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2414:x1874208182388096:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384715.123994:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2414:x1874208182388096:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 25us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384715.123999:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 95 00000100:00080000:1.0:1787384715.124417:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384715.124422:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384715.125022:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384715.125048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384715.125103:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182388352 00000100:00100000:3.0:1787384715.125110:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182388352 00000100:00100000:3.0:1787384715.125160:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182388480 00000100:00100000:3.0:1787384715.125163:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182388480 00000100:00100000:3.0:1787384715.125184:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 96 00000100:00100000:3.0:1787384715.125192:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2414:x1874208182388352:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384715.125245:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2414:x1874208182388352:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 53us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384715.125252:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 96 00000100:00100000:3.0:1787384715.125268:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 97 00000100:00100000:3.0:1787384715.125275:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2413:x1874208182388480:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384715.125301:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2413:x1874208182388480:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 27us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384715.125306:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 97 00000100:00080000:1.0:1787384715.125543:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384715.125547:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787384715.641904:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384716.663188:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384716.729184:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384716.729582:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203435648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384716.729745:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384716.730050:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203435648 00000100:00100000:0.0:1787384716.730059:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203435648 00000100:00100000:0.0:1787384716.730124:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787384716.730134:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203435648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384716.730164:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384716.730227:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203435648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384716.730234:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787384716.730555:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384716.734643:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203435648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384717.445366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384717.448410:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182388608 00000100:00100000:2.0:1787384717.448436:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182388608 00000100:00100000:3.0:1787384717.448930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384717.452238:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384717.452497:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182388864 00000100:00100000:2.0:1787384717.452508:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182388864 00000100:00100000:2.0:1787384717.452570:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:2.0:1787384717.452580:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b965c805-ceb8-4757-b53e-03d6d45231a8+14:2416:x1874208182388608:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384717.452594:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384717.452623:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3dda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aea expref: 14 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384717.452641:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384717.452698:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b965c805-ceb8-4757-b53e-03d6d45231a8+13:2416:x1874208182388608:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 119us (7340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384717.452706:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:2.0:1787384717.452725:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:2.0:1787384717.452743:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b965c805-ceb8-4757-b53e-03d6d45231a8+12:2416:x1874208182388864:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384717.452768:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384717.452808:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090000/0x7ef423838fba3e9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bd1 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384717.452818:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384717.452838:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b965c805-ceb8-4757-b53e-03d6d45231a8+11:2416:x1874208182388864:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 96us (3913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384717.452844:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:3.0:1787384717.457574:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384717.457702:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182388736 00000100:00100000:2.0:1787384717.457714:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182388736 00000100:00100000:2.0:1787384717.457806:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:2.0:1787384717.457817:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b965c805-ceb8-4757-b53e-03d6d45231a8+11:2416:x1874208182388736:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384717.457834:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384717.457863:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba3de1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b1b expref: 11 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384717.457886:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384717.457936:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b965c805-ceb8-4757-b53e-03d6d45231a8+10:2416:x1874208182388736:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 121us (5709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384717.457944:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:1.0:1787384717.458054:0:19186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182389120 00000100:00100000:1.0:1787384717.458058:0:19186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182389120 00000100:00100000:1.0:1787384717.458105:0:19186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 35 00000100:00100000:1.0:1787384717.458112:0:19186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2412:x1874208182389120:12345-192.168.203.45@tcp:9:umount.0 00000020:00000080:1.0:1787384717.458156:0:19186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3e04 00000020:00010000:1.0:1787384717.458164:0:19186:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98f8f87a1800: total 0 00000100:00080000:1.0:1787384717.458169:0:19186:0:(import.c:65:import_set_state_nolock()) ffff98f7c4321800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787384717.458213:0:19186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1787384717.458345:0:19186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+4:2412:x1874208182389120:12345-192.168.203.45@tcp:9:umount.0 Request processed in 233us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384717.458352:0:19186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 35 00000020:00010000:1.0:1787384717.458404:0:17902:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98f8f87a1800: total 0 00010000:00010000:1.0:1787384717.458408:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384717.458430:0:17902:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98f8f87a1800, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1787384717.458457:0:17902:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787384717.458460:0:17902:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787384699 -> 1787384700 00002000:00010000:1.0:1787384717.458463:0:17902:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787384699 -> 1787384700 00002000:00010000:1.0:1787384717.458466:0:17902:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787384717.458484:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae0da09f/0x7ef423838fba4176 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3cb1 expref: 3 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384717.458505:0:17902:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98f8f87a1800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787384717.458517:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384717.458519:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384717.458521:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787384717.458988:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384717.476892:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384717.477021:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182390016 00000100:00100000:3.0:1787384717.477031:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182390016 00000100:00100000:3.0:1787384717.477106:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 76 00000100:00100000:3.0:1787384717.477117:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+12:2412:x1874208182390016:12345-192.168.203.45@tcp:39:umount.0 00000020:00000080:3.0:1787384717.477164:0:17152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3def 00000020:00010000:3.0:1787384717.477180:0:17152:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98f7c2368800: total 0 00000100:00080000:3.0:1787384717.477185:0:17152:0:(import.c:65:import_set_state_nolock()) ffff98f7c236c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787384717.477225:0:17152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:3.0:1787384717.477373:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+11:2412:x1874208182390016:12345-192.168.203.45@tcp:39:umount.0 Request processed in 258us (490us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1787384717.477382:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 76 00000020:00010000:1.0:1787384717.478125:0:17138:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98f7c2368800: total 0 00010000:00010000:1.0:1787384717.478177:0:17138:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98f7c2368800, canceled 0 locks, left on hash table 7. 00010000:00010000:1.0:1787384717.478222:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:1.0:1787384717.478227:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787384717.478235:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c17 expref: 10 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384717.478278:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:1.0:1787384717.478281:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787384717.478286:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba411b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c8e expref: 9 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384717.478300:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9dd00) 00010000:00010000:1.0:1787384717.478303:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384717.478307:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba3ed6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bdf expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384717.478322:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9d500) 00010000:00010000:1.0:1787384717.478324:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384717.478327:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3f15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bed expref: 7 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384717.478338:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384717.478341:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384717.478344:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090600/0x7ef423838fba40c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c79 expref: 6 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384717.478355:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384717.478357:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787384717.478360:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4184 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3cb8 expref: 5 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384717.478374:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f8fc248200) 00010000:00010000:1.0:1787384717.478377:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384717.478387:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3eba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bd8 expref: 4 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384717.478401:0:17138:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98f7c2368800, canceled 7 locks, left on hash table 0. 00010000:00010000:1.0:1787384717.478425:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384717.478427:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384717.478429:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787384717.479585:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384717.485670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384717.485821:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182390144 00000100:00100000:0.0:1787384717.485837:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182390144 00000100:00100000:0.0:1787384717.485926:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 77 00000100:00100000:0.0:1787384717.485953:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2412:x1874208182390144:12345-192.168.203.45@tcp:39:umount.0 00000020:00000080:0.0:1787384717.485988:0:17150:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3df6 00000100:00080000:0.0:1787384717.486007:0:17150:0:(import.c:65:import_set_state_nolock()) ffff98f7c2228000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787384717.486031:0:17150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1787384717.486281:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787384717.486344:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384717.489347:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+3:2412:x1874208182390144:12345-192.168.203.45@tcp:39:umount.0 Request processed in 3386us (3680us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787384717.489362:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 77 00010000:00010000:1.0:1787384717.687401:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384717.751124:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203435776:0@lo:400:kworker.0 00000100:00100000:3.0:1787384717.751256:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384717.751285:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203435904:0@lo:400:kworker.0 00000100:00100000:3.0:1787384717.751331:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203436288:0@lo:400:kworker.0 00000100:00100000:2.0:1787384717.751365:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384717.751382:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384717.751425:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203436800:0@lo:400:kworker.0 00000100:00100000:3.0:1787384717.751448:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384717.751467:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203437312:0@lo:400:kworker.0 00000100:00100000:3.0:1787384717.751492:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384717.751586:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203435904 00000100:00100000:3.0:1787384717.751596:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203435776 00000100:00100000:1.0:1787384717.751597:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203435904 00000100:00100000:3.0:1787384717.751607:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203435776 00000100:00100000:1.0:1787384717.751659:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787384717.751670:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203435904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.751741:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203435904:12345-0@lo:400:kworker.0 Request processed in 72us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384717.751748:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787384717.751805:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384717.751817:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203437440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384717.751846:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384717.751878:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203436032:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.751903:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384717.751921:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203436544:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.751940:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384717.751955:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203437056:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.751982:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384717.752001:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203437568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384717.752028:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384717.752041:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787384717.752055:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:3651:x1874208203435776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.752069:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787384717.752081:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203436160:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.752122:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384717.752133:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:3651:x1874208203435776:12345-0@lo:400:kworker.0 Request processed in 79us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384717.752143:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787384717.752155:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203436672:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.752189:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384717.752195:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203436288 00000100:00100000:3.0:1787384717.752202:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203436288 00000100:00100000:1.0:1787384717.752214:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203437184:0@lo:400:kworker.0 00000100:00100000:3.0:1787384717.752245:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203436800 00000100:00100000:3.0:1787384717.752251:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203436800 00000100:00100000:1.0:1787384717.752258:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384717.752278:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203437312 00000100:00100000:3.0:1787384717.752283:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203437312 00000100:00100000:1.0:1787384717.752298:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203436032 00000100:00100000:1.0:1787384717.752305:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203436032 00000100:00100000:3.0:1787384717.752319:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203437056 00000100:00100000:3.0:1787384717.752324:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203437056 00000100:00100000:1.0:1787384717.752339:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203436544 00000100:00100000:1.0:1787384717.752346:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203436544 00000100:00100000:3.0:1787384717.752353:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203437184 00000100:00100000:3.0:1787384717.752359:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203437184 00000100:00100000:1.0:1787384717.752380:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203436160 00000100:00100000:1.0:1787384717.752387:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203436160 00000100:00100000:3.0:1787384717.752393:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787384717.752403:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203436288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384717.752446:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203436288:12345-0@lo:400:kworker.0 Request processed in 46us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384717.752452:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787384717.752467:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787384717.752472:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203436800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384717.752497:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203436800:12345-0@lo:400:kworker.0 Request processed in 25us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384717.752503:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787384717.752513:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787384717.752518:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203437312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384717.752542:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203437312:12345-0@lo:400:kworker.0 Request processed in 24us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384717.752548:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787384717.752550:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203436672 00000100:00100000:1.0:1787384717.752557:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203436672 00000100:00100000:3.0:1787384717.752565:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787384717.752576:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203437056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.752595:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384717.752610:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203436032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384717.752622:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203437056:12345-0@lo:400:kworker.0 Request processed in 47us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384717.752661:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203436032:12345-0@lo:400:kworker.0 Request processed in 55us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384717.752669:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384717.752684:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787384717.752689:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203436544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.752715:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203436544:12345-0@lo:400:kworker.0 Request processed in 26us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384717.752722:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787384717.752742:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787384717.752748:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203436160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.752809:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203436160:12345-0@lo:400:kworker.0 Request processed in 61us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384717.752815:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787384717.752827:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384717.752832:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203436672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.752857:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203436672:12345-0@lo:400:kworker.0 Request processed in 25us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384717.752862:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384717.752911:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203436160:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.752922:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203436672:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.752931:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203436032:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.752939:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203436544:0@lo:400:kworker.0 00010000:00080000:1.0:1787384717.752951:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c42f0700 x1874208203437056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384717.752962:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203437056:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.753026:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787384717.753035:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203437184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.753070:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203437184:12345-0@lo:400:kworker.0 Request processed in 37us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384717.753077:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787384717.753109:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203435776:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.753121:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203436288:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.753142:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203436800:0@lo:400:kworker.0 00010000:00080000:1.0:1787384717.753154:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c42f3100 x1874208203437312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384717.753164:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203437312:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.753193:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203437184:0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.753236:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203437440 00000100:00100000:1.0:1787384717.753240:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203437440 00000100:00100000:3.0:1787384717.753261:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787384717.753279:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203437568 00000100:00100000:1.0:1787384717.753285:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203437568 00000100:00100000:3.0:1787384717.753307:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787384717.753319:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203437440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384717.753351:0:19944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787384717.753415:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203437440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384717.753597:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203436416:0@lo:400:kworker.0 00000100:00100000:2.0:1787384717.753647:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384717.753674:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203436928:0@lo:400:kworker.0 00000100:00100000:2.0:1787384717.753693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384717.753722:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203435904:0@lo:400:kworker.0 00000100:00100000:2.0:1787384717.753763:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203436928 00000100:00100000:2.0:1787384717.753766:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203436928 00000100:00100000:1.0:1787384717.753872:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787384717.753882:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203437568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384717.753899:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787384717.753938:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203437568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384717.753945:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787384717.753982:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203437568:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787384717.754014:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384717.754019:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384717.754021:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384717.754023:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384717.754042:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203437440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384717.754250:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203436416 00000100:00100000:1.0:1787384717.754256:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203436416 00000100:00100000:1.0:1787384717.754283:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787384717.754289:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203436416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384717.754336:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203436416:12345-0@lo:400:kworker.0 Request processed in 47us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384717.754342:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787384717.754887:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203437696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384717.754921:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384717.754952:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203437696 00000100:00100000:0.0:1787384717.754955:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203437696 00000100:00100000:0.0:1787384717.754980:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787384717.754986:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203437696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384717.754998:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787384717.755029:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203437696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384717.755035:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787384717.755066:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203437696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384717.755589:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787384717.755600:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203436928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384717.755635:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203436928:12345-0@lo:400:kworker.0 Request processed in 39us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384717.755641:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787384717.755681:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203436416:0@lo:400:kworker.0 00000100:00100000:2.0:1787384717.755691:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203436928:0@lo:400:kworker.0 00000100:00100000:3.0:1787384717.756219:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787384718.263224:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384718.263265:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203437824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384718.263371:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384718.263468:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203437824 00000100:00100000:1.0:1787384718.263480:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203437824 00000100:00100000:1.0:1787384718.263544:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787384718.263554:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203437824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384718.263589:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384718.263666:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203437824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384718.263675:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787384718.264034:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384718.264051:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203437952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384718.264091:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384718.264168:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203437952 00000100:00100000:1.0:1787384718.264173:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203437952 00000100:00100000:1.0:1787384718.264203:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787384718.264210:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203437952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384718.264240:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787384718.264290:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203437952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384718.264297:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787384718.264357:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203437824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384718.264458:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203437952:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787384718.455161:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787384718.455171:0:17184:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384718.455193:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787384718.455200:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787384718.714313:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384719.185137:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384719.185194:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384719.185227:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384719.185393:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182390272 00000100:00100000:1.0:1787384719.185406:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182390272 00000100:00100000:1.0:1787384719.185500:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182390400 00000100:00100000:1.0:1787384719.185504:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182390400 00000100:00100000:1.0:1787384719.185520:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182390528 00000100:00100000:1.0:1787384719.185522:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182390528 00000100:00100000:1.0:1787384719.185540:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:1.0:1787384719.185550:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b965c805-ceb8-4757-b53e-03d6d45231a8+12:2415:x1874208182390272:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384719.185588:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384719.185612:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58ccc00/0x7ef423838fba3e19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b5a expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384719.185633:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384719.185712:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b965c805-ceb8-4757-b53e-03d6d45231a8+11:2415:x1874208182390272:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 163us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384719.185732:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:1.0:1787384719.185952:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:1.0:1787384719.185959:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b965c805-ceb8-4757-b53e-03d6d45231a8+10:2415:x1874208182390400:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384719.185970:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384719.185980:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba3e20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b8b expref: 10 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384719.185989:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384719.186010:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b965c805-ceb8-4757-b53e-03d6d45231a8+9:2415:x1874208182390400:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 52us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384719.186016:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:1.0:1787384719.186027:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:1.0:1787384719.186034:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b965c805-ceb8-4757-b53e-03d6d45231a8+8:2416:x1874208182390528:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384719.186042:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384719.186051:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba3e89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bca expref: 8 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384719.186058:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384719.186074:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b965c805-ceb8-4757-b53e-03d6d45231a8+7:2416:x1874208182390528:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 41us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384719.186087:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:3.0:1787384719.188917:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384719.189351:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182390784 00000100:00100000:0.0:1787384719.189368:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182390784 00000100:00100000:0.0:1787384719.189480:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 78 00000100:00100000:0.0:1787384719.189506:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2412:x1874208182390784:12345-192.168.203.45@tcp:39:umount.0 00000020:00000080:0.0:1787384719.189550:0:18681:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3e2e 00000020:00010000:0.0:1787384719.189559:0:18681:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98f8fde24800: total 0 00000100:00080000:0.0:1787384719.189563:0:18681:0:(import.c:65:import_set_state_nolock()) ffff98f8fde27000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787384719.189587:0:18681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:0.0:1787384719.189755:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2412:x1874208182390784:12345-192.168.203.45@tcp:39:umount.0 Request processed in 248us (850us total) trans 8589934638 rc 0/0 00000100:00100000:0.0:1787384719.189764:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 78 00000020:00010000:0.0:1787384719.189851:0:17139:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98f8fde24800: total 0 00010000:00010000:0.0:1787384719.189896:0:17139:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98f8fde24800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787384719.189931:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9d500) 00010000:00010000:0.0:1787384719.189934:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384719.189942:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3f23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bf4 expref: 4 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384719.189971:0:17139:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98f8fde24800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787384719.189989:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384719.189993:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787384719.189997:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787384719.189998:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384719.202912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384719.209864:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182390912 00000100:00100000:1.0:1787384719.209888:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182390912 00000100:00100000:1.0:1787384719.210024:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 79 00000100:00100000:1.0:1787384719.210038:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2412:x1874208182390912:12345-192.168.203.45@tcp:39:umount.0 00000020:00000080:1.0:1787384719.210100:0:17151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3e35 00000100:00080000:1.0:1787384719.210113:0:17151:0:(import.c:65:import_set_state_nolock()) ffff98f8d01e1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787384719.210156:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1787384719.210371:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+3:2412:x1874208182390912:12345-192.168.203.45@tcp:39:umount.0 Request processed in 336us (7472us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787384719.210380:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 79 00010000:00010000:0.0:1787384719.210751:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787384719.210824:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384719.244058:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384719.244192:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182391168 00000100:00100000:0.0:1787384719.244217:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182391168 00000100:00100000:0.0:1787384719.244294:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 175 00000100:00100000:0.0:1787384719.244306:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+7:2412:x1874208182391168:12345-192.168.203.45@tcp:251:umount.0 00000020:00000080:0.0:1787384719.244365:0:17142:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3dcc 00000020:00010000:0.0:1787384719.244374:0:17142:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98f7c222f000: total 0 00000100:00080000:0.0:1787384719.244380:0:17142:0:(import.c:65:import_set_state_nolock()) ffff98f7c222c800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787384719.244478:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+3:2412:x1874208182391168:12345-192.168.203.45@tcp:251:umount.0 Request processed in 174us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384719.244505:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 175 00000020:00010000:1.0:1787384719.244744:0:17138:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98f7c222f000: total 0 00010000:00010000:1.0:1787384719.244749:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384719.244851:0:17138:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98f7c222f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787384719.244899:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cc200/0x7ef423838fba3dd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ae3 expref: 2 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384719.244918:0:17138:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98f7c222f000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787384719.244931:0:17138:0:(genops.c:906:class_export_put()) final put ffff98f7c222f000/b965c805-ceb8-4757-b53e-03d6d45231a8 00010000:00010000:1.0:1787384719.244952:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384719.244954:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384719.244956:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787384719.244998:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c222f000/b965c805-ceb8-4757-b53e-03d6d45231a8 for MGS 00000020:00000080:3.0:1787384719.245047:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c222c800 for MGS 00010000:00010000:0.0:1787384719.751027:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384720.762298:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787384721.122490:0:20723:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787384721.140017:0:20723:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787384721.140075:0:20723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384721.140089:0:20723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384721.140095:0:20723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384721.140118:0:20723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384721.140137:0:20723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787384721.140276:0:20723:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787384721.140303:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787384721.140307:0:20723:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787384721.140313:0:20723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787384721.140334:0:20723:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d8a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787384721.140636:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203438080:0@lo:39:umount.0 00010000:00010000:1.0:1787384721.140728:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384721.140735:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384721.140753:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158000 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384721.140757:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384721.140765:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384721.140773:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384721.140814:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787384721.140817:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787384721.140820:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787384721.140844:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384721.140850:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384721.140869:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384721.140883:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384721.140897:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384721.140899:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384721.140900:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384721.141748:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384721.141847:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203438208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384721.141891:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384721.141948:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203438080 00000100:00100000:0.0:1787384721.141955:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203438080 00000100:00100000:0.0:1787384721.141998:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787384721.142018:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874208203438080:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787384721.142045:0:18681:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba39c0 00000100:00080000:0.0:1787384721.142054:0:18681:0:(import.c:65:import_set_state_nolock()) ffff98f8f943c000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787384721.142106:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3650:x1874208203438080:12345-0@lo:39:umount.0 Request processed in 99us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384721.142113:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:0.0:1787384721.142123:0:18681:0:(genops.c:906:class_export_put()) final put ffff98f8f943e000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1787384721.142148:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203438208 00000100:00100000:0.0:1787384721.142152:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203438208 00000100:00100000:0.0:1787384721.142189:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384721.142195:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8523c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57899b24-a33b-4177-9883-79b5fe35053f+24:3653:x1874208203438208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384721.142206:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384721.142222:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3952000/0x7ef423838fba3996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba398f expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.142235:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384721.142272:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8523c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57899b24-a33b-4177-9883-79b5fe35053f+23:3653:x1874208203438208:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384721.142279:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787384721.142328:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787384721.142337:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f943e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787384721.142377:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f943c000 for lustre-MDT0000 00000100:00100000:0.0:1787384721.142646:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203438208:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787384721.142678:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d8a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787384721.142696:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203438080:0@lo:39:umount.0 00000100:00080000:2.0:1787384721.142728:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787384721.142732:0:20723:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787384721.142737:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787384721.143635:0:20723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143649:0:20723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143672:0:20723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143679:0:20723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143711:0:20723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384721.143718:0:20723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143724:0:20723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143730:0:20723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.143732:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384721.143736:0:20723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.143739:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.143745:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902159800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384721.143749:0:17902:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143752:0:20723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384721.143759:0:20723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.143759:0:17902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143766:0:20723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384721.143767:0:17902:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143773:0:20723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384721.143773:0:17902:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787384721.143790:0:17902:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787384721.143804:0:20723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143816:0:20723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787384721.143822:0:20723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143829:0:20723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143835:0:20723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143841:0:20723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384721.143849:0:20723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1787384721.143853:0:20723:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787384721.143857:0:20723:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787384721.143896:0:20723:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787384721.143900:0:20723:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787384721.143904:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384721.143910:0:20723:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1787384721.143915:0:20723:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98f8f569c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787384721.143921:0:20723:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98f7c4322800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787384721.143926:0:20723:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98f8ee0ce000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787384721.143931:0:20723:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98f7c2052000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787384721.143947:0:20723:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff98f8fde24800 bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 192.168.203.45@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1787384721.143951:0:20723:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff98f7c2368800 8741dc33-c445-439b-a6e3-d8ded553bb00 192.168.203.45@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:2.0:1787384721.143956:0:20723:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff98f8f91f0000) has exports, disconnecting them 00000020:00080000:2.0:1787384721.143960:0:20723:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98f8f569c000), last request at 1787384717 00010000:00010000:0.0:1787384721.143963:0:17902:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787384721.143965:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3cbb 00010000:00010000:0.0:1787384721.143969:0:17902:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:2.0:1787384721.143980:0:20723:0:(import.c:65:import_set_state_nolock()) ffff98f8f569d000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787384721.143993:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.143999:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787384721.144018:0:20723:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f8f569c000): rc 0 00000020:00000080:2.0:1787384721.144020:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8f569c000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1787384721.144020:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787384721.144023:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144028:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091800 already unused, calling callback (ffffffffc12b6c20) 00000020:00080000:2.0:1787384721.144030:0:20723:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98f7c4322800), last request at 1787384717 10000000:00010000:0.0:1787384721.144032:0:17902:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787384721.144033:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3b5d 00000100:00080000:2.0:1787384721.144037:0:20723:0:(import.c:65:import_set_state_nolock()) ffff98f7c4323000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787384721.144038:0:17902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787384721.144042:0:20723:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c4322800): rc 0 00000020:00000080:2.0:1787384721.144044:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f7c4322800/lustre-MDT0000-lwp-OST0000_UUID 10000000:00010000:0.0:1787384721.144045:0:17902:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787384721.144048:0:20723:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98f8ee0ce000), last request at 1787384641 00000020:00000080:2.0:1787384721.144050:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3aae 10000000:01000000:0.0:1787384721.144051:0:17902:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00080000:2.0:1787384721.144053:0:20723:0:(import.c:65:import_set_state_nolock()) ffff98f8ee0c8000 : changing import state from FULL to CLOSED 10000000:01000000:0.0:1787384721.144053:0:17902:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787384721.144055:0:17902:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:2.0:1787384721.144057:0:20723:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f8ee0ce000): rc 0 00000020:00000080:2.0:1787384721.144059:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8ee0ce000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787384721.144063:0:20723:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98f7c2052000), last request at 1787384641 00000020:00000080:2.0:1787384721.144066:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3a4c 00010000:00010000:0.0:1787384721.144067:0:17902:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787384721.144069:0:20723:0:(import.c:65:import_set_state_nolock()) ffff98f7c2055000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787384721.144072:0:17902:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000001:00000004:2.0:1787384721.144073:0:20723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00010000:00010000:0.0:1787384721.144088:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144094:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144112:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384721.144115:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144120:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384721.144122:0:17902:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144129:0:17902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384721.144135:0:17902:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787384721.144140:0:20723:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c2052000): rc 0 10000000:01000000:0.0:1787384721.144140:0:17902:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787384721.144142:0:17902:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787384721.144144:0:17902:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000004:00000080:2.0:1787384721.144146:0:20723:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac6941503ae0 00010000:00010000:0.0:1787384721.144156:0:17902:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787384721.144161:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00010000:00010000:0.0:1787384721.144161:0:17902:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787384721.144164:0:20723:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1787384721.144167:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144172:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144179:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384721.144182:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144193:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384721.144196:0:17902:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144203:0:17902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384721.144209:0:17902:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384721.144324:0:17902:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787384721.144327:0:17902:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787384721.144329:0:17902:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787384721.144343:0:17902:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144350:0:17902:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384721.144355:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144362:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144371:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384721.144372:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384721.144374:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384721.144454:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203438464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384721.144505:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384721.144533:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384721.144545:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203438592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384721.144566:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384721.144598:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203438464 00000100:00100000:0.0:1787384721.144603:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203438464 00000100:00100000:0.0:1787384721.144636:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203438592 00000100:00100000:0.0:1787384721.144639:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203438592 00000100:00100000:0.0:1787384721.144657:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384721.144665:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57899b24-a33b-4177-9883-79b5fe35053f+24:3651:x1874208203438464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384721.144676:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384721.144687:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3cf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba3cec expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.144699:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384721.144739:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57899b24-a33b-4177-9883-79b5fe35053f+23:3651:x1874208203438464:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384721.144746:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384721.144760:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787384721.144766:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57899b24-a33b-4177-9883-79b5fe35053f+22:3651:x1874208203438592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384721.144773:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:2.0:1787384721.144935:0:20723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787384721.144952:0:20723:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787384721.145084:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787384721.145088:0:20723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1787384721.145098:0:20723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1787384721.145132:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba3e97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba3e90 expref: 22 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.145142:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1787384721.145155:0:20723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787384721.145163:0:20723:0:(import.c:65:import_set_state_nolock()) ffff98f8d8503000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787384721.145167:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57899b24-a33b-4177-9883-79b5fe35053f+21:3651:x1874208203438592:12345-0@lo:103:ldlm_bl.0 Request processed in 402us (600us total) trans 0 rc 0/0 00000100:00080000:2.0:1787384721.145169:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787384721.145172:0:20723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000100:00100000:0.0:1787384721.145173:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:2.0:1787384721.145187:0:20723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787384721.145203:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203438336:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787384721.145242:0:20723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787384721.145250:0:20723:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787384721.145288:0:20723:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff98f8f91f0000) has no exports 00000100:00100000:0.0:1787384721.145338:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384721.145363:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384721.145369:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203438720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384721.145466:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787384721.145498:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f569c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787384721.145536:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c4322800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787384721.145554:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee0ce000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787384721.145576:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f569d000 for lustre-MDT0000 00000020:00000080:0.0:1787384721.145580:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c4323000 for lustre-MDT0000 00000020:00000080:0.0:1787384721.145583:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8ee0c8000 for lustre-MDT0000 00010000:00010000:0.0:1787384721.145594:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384721.145623:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203438592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384721.145630:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203438464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384721.145651:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203438336 00000100:00100000:0.0:1787384721.145655:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203438336 00000100:00100000:0.0:1787384721.145678:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203438720 00000100:00100000:0.0:1787384721.145681:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203438720 00000100:00100000:0.0:1787384721.145694:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384721.145700:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57899b24-a33b-4177-9883-79b5fe35053f+22:3654:x1874208203438336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384721.145720:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384721.145731:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c6140c00/0x7ef423838fba38e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba38e0 expref: 22 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.145741:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384721.145769:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57899b24-a33b-4177-9883-79b5fe35053f+21:3654:x1874208203438336:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384721.146066:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384721.146086:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787384721.146101:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57899b24-a33b-4177-9883-79b5fe35053f+20:3654:x1874208203438720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384721.146109:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384721.146118:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c6141400/0x7ef423838fba38d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba38d2 expref: 20 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384721.146127:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384721.146151:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57899b24-a33b-4177-9883-79b5fe35053f+19:3654:x1874208203438720:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384721.146157:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787384721.146186:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203438720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384721.146195:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203438336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384721.146526:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203438848:0@lo:39:umount.0 00000100:00100000:0.0:1787384721.146563:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384721.146589:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203438976:0@lo:9:umount.0 00000100:00100000:0.0:1787384721.146610:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384721.146628:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203439104:0@lo:9:umount.0 00000100:00100000:0.0:1787384721.146647:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384721.146675:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203438848 00000100:00100000:0.0:1787384721.146680:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203438848 00000100:00100000:0.0:1787384721.146721:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787384721.146727:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874208203438848:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787384721.146753:0:17156:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3ad8 00000100:00080000:0.0:1787384721.146759:0:17156:0:(import.c:65:import_set_state_nolock()) ffff98f8f569f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787384721.147745:0:17156:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:1.0:1787384721.148853:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384721.149623:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3650:x1874208203438848:12345-0@lo:39:umount.0 Request processed in 2891us (3054us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787384721.149646:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787384721.149682:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203438976 00000100:00100000:0.0:1787384721.149689:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203438976 00000100:00100000:0.0:1787384721.149740:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203439104 00000100:00100000:0.0:1787384721.149744:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203439104 00000100:00100000:0.0:1787384721.149762:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787384721.149770:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874208203438976:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787384721.150329:0:18656:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3ba3 00000100:00080000:0.0:1787384721.150340:0:18656:0:(import.c:65:import_set_state_nolock()) ffff98f8d01e6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787384721.150397:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787384721.150509:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3650:x1874208203438976:12345-0@lo:9:umount.0 Request processed in 739us (3897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384721.150517:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787384721.150532:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787384721.150539:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874208203439104:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787384721.150551:0:18656:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3cfa 00000100:00080000:0.0:1787384721.150557:0:18656:0:(import.c:65:import_set_state_nolock()) ffff98f7c3a39800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787384721.150580:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1787384721.150644:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3650:x1874208203439104:12345-0@lo:9:umount.0 Request processed in 105us (3994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384721.150650:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787384721.150685:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384721.150689:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787384721.150725:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787384721.150756:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787384721.150763:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203438848:0@lo:39:umount.0 00000100:00080000:0.0:1787384721.150775:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d8503000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787384721.150853:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787384721.150855:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787384721.150859:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203438976:0@lo:9:umount.0 00010000:00010000:2.0:1787384721.151165:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787384721.151449:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787384721.151469:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787384721.151471:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787384721.151476:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203439104:0@lo:9:umount.0 00010000:00010000:0.0:1787384721.151513:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787384721.159920:0:20723:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff98f8f91f0000) has no exports 00000020:00000080:3.0:1787384721.219010:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba392d 00000020:00000080:3.0:1787384721.219181:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8f91fc800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787384721.219297:0:20723:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787384721.224966:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f91fc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787384721.225081:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384721.225093:0:20723:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787384721.225098:0:20723:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff98f8f54b4d40) has no exports 00000020:00000080:2.0:1787384721.225531:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3926 00000020:00000080:2.0:1787384721.225541:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f7c3bfc000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787384721.225601:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787384721.225608:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787384721.225610:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8f91ff000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787384721.225613:0:20723:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f91ff000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787384721.225623:0:20723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787384721.225911:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3bfc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787384721.784155:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384722.807331:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384722.871541:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203439232:0@lo:400:kworker.0 00000100:00100000:2.0:1787384722.871565:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203439616:0@lo:400:kworker.0 00000100:00100000:0.0:1787384722.871566:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203439488:0@lo:400:kworker.0 00000100:00100000:1.0:1787384722.871711:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203439360:0@lo:400:kworker.0 00000100:00100000:2.0:1787384722.879066:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384722.880433:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384722.880488:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203440000:0@lo:400:kworker.0 00000100:00100000:0.0:1787384722.880531:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384722.880563:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203440512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384722.880599:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384722.880639:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203439616 00000100:00100000:0.0:1787384722.880647:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203439616 00000100:00100000:0.0:1787384722.881057:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203439488 00000100:00100000:0.0:1787384722.881062:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203439488 00000100:00100000:0.0:1787384722.881092:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787384722.881101:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203439616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384722.881160:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203439616:12345-0@lo:400:kworker.0 Request processed in 60us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384722.881167:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787384722.881185:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787384722.881205:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203439488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384722.881240:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203439488:12345-0@lo:400:kworker.0 Request processed in 36us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384722.881246:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787384722.881269:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203440512 00000100:00100000:0.0:1787384722.881273:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203440512 00000100:00100000:0.0:1787384722.881295:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787384722.881301:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203440512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384722.881319:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787384722.881347:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203440512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384722.881352:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787384722.881366:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787384722.881369:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384722.881409:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203440512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384722.881420:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203439488:0@lo:400:kworker.0 00000100:00100000:0.0:1787384722.881622:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203440000 00000100:00100000:0.0:1787384722.881627:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203440000 00000100:00100000:0.0:1787384722.881655:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787384722.881660:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874208203440000:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787384722.881667:0:17151:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787384722.881936:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874208203440000:12345-0@lo:400:kworker.0 Request processed in 273us (1403us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787384722.881942:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1787384722.881996:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787384722.882002:0:3652:0:(import.c:65:import_set_state_nolock()) ffff98f8f5698800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787384722.882011:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787384722.882481:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203439616:0@lo:400:kworker.0 00000100:00100000:2.0:1787384722.882494:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203440128:0@lo:400:kworker.0 00000100:00100000:2.0:1787384722.882551:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384722.882587:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384722.885042:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203440256:0@lo:400:kworker.0 00000100:00100000:2.0:1787384722.885127:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384722.885214:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203440128 00000100:00100000:2.0:1787384722.885222:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203440128 00000100:00100000:3.0:1787384722.885966:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384722.886010:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203439744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384722.886047:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384722.886071:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203439744 00000100:00100000:3.0:1787384722.886075:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203439744 00000100:00100000:3.0:1787384722.886120:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787384722.886128:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203439744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384722.886165:0:19944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787384722.886236:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203439744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384722.886254:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787384722.886902:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203440256 00000100:00100000:2.0:1787384722.886908:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203440256 00000100:00100000:2.0:1787384722.886926:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787384722.886935:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203440128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384722.887010:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203440128:12345-0@lo:400:kworker.0 Request processed in 78us (4469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384722.887017:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787384722.887031:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787384722.887036:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1874208203440256:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787384722.887041:0:17152:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787384722.887067:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1874208203440256:12345-0@lo:400:kworker.0 Request processed in 29us (1940us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787384722.887072:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787384722.887931:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203439744:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1787384722.887959:0:17883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787384722.887970:0:17883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1787384722.887974:0:17883:0:(genops.c:906:class_export_put()) final put ffff98f8f569e800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787384722.887991:0:17883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 00000001:00080000:2.0:1787384722.887998:0:17883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1787384722.888001:0:17883:0:(genops.c:906:class_export_put()) final put ffff98f8d01e2800/bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 00000001:00100000:2.0:1787384722.888007:0:17883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8741dc33-c445-439b-a6e3-d8ded553bb00 00000100:00080000:3.0:1787384722.888011:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000001:00080000:2.0:1787384722.888012:0:17883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000100:00080000:3.0:1787384722.888017:0:3653:0:(import.c:65:import_set_state_nolock()) ffff98f7c236d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000020:00000080:2.0:1787384722.888023:0:17883:0:(genops.c:906:class_export_put()) final put ffff98f7c222f800/8741dc33-c445-439b-a6e3-d8ded553bb00 00000100:02000400:3.0:1787384722.888024:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787384722.888031:0:3653:0:(import.c:65:import_set_state_nolock()) ffff98f7c236d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384722.888035:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 566 00000100:00080000:3.0:1787384722.888042:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f7c236d800 using connection 192.168.203.145@tcp/0@lo 00000100:00080000:2.0:1787384722.888057:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384722.888067:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f54f8000 x1874208203440640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1787384722.888082:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f569e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000100:00100000:3.0:1787384722.888093:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203440256:0@lo:400:kworker.0 00010000:00080000:3.0:1787384722.888110:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f4a47100 x1874208203440128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384722.888121:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203440128:0@lo:400:kworker.0 00000020:00000080:2.0:1787384722.888134:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d01e2800/bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 for lustre-MDT0001 00000020:00000080:2.0:1787384722.888163:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c222f800/8741dc33-c445-439b-a6e3-d8ded553bb00 for lustre-MDT0001 00000100:00100000:3.0:1787384722.888166:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203440640:0@lo:38:ptlrpcd_00_02.0 00000020:00000080:2.0:1787384722.888193:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f569f000 for lustre-MDT0001 00000020:00000080:2.0:1787384722.888199:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8d01e1800 for lustre-MDT0001 00000020:00000080:2.0:1787384722.888203:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c2228000 for lustre-MDT0001 00000100:00100000:3.0:1787384722.888214:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384722.888235:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203440640 00000100:00100000:2.0:1787384722.888241:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203440640 00000100:00100000:2.0:1787384722.888268:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787384722.888274:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874208203440640:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1787384722.888289:0:17152:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787384722.889804:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384722.889886:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203439872:0@lo:400:kworker.0 00000100:00100000:1.0:1787384722.889922:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384722.889944:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203440384:0@lo:400:kworker.0 00000100:00100000:1.0:1787384722.889964:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384722.890009:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203439232 00000100:00100000:3.0:1787384722.890197:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203439360 00000100:00100000:3.0:1787384722.890202:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203439360 00000100:00100000:3.0:1787384722.890241:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787384722.890248:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1874208203439360:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787384722.890256:0:17156:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787384722.890299:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1874208203439360:12345-0@lo:400:kworker.0 Request processed in 49us (499us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787384722.890306:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787384722.890345:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203439872 00000100:00100000:3.0:1787384722.890350:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203439872 00000100:00100000:3.0:1787384722.890378:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203440384 00000100:00100000:3.0:1787384722.890382:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203440384 00000100:00100000:3.0:1787384722.890413:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787384722.890419:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203440384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384722.890459:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203440384:12345-0@lo:400:kworker.0 Request processed in 40us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384722.890465:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787384722.890479:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787384722.890483:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1874208203439872:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787384722.890488:0:17150:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787384722.890510:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1874208203439872:12345-0@lo:400:kworker.0 Request processed in 26us (587us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787384722.890516:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787384722.890543:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384722.891368:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203439232 00000100:00100000:1.0:1787384722.891420:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787384722.891428:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+19:3654:x1874208203439232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384722.891482:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+19:3654:x1874208203439232:12345-0@lo:400:kworker.0 Request processed in 56us (5517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384722.891489:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:1.0:1787384722.891548:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787384722.891553:0:3651:0:(import.c:65:import_set_state_nolock()) ffff98f8f87a4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787384722.891557:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787384722.891562:0:3651:0:(import.c:65:import_set_state_nolock()) ffff98f8f87a4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384722.891566:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:1.0:1787384722.891572:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98f8f87a4800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384722.892195:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8ee117b80 x1874208203440768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384722.892218:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203439360:0@lo:400:kworker.0 00000100:00080000:1.0:1787384722.892237:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787384722.892240:0:3651:0:(import.c:65:import_set_state_nolock()) ffff98f8ee0cb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787384722.892243:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787384722.892248:0:3651:0:(import.c:65:import_set_state_nolock()) ffff98f8ee0cb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384722.892264:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:1.0:1787384722.892270:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98f8ee0cb000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384722.892283:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8ee114000 x1874208203440896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384722.892294:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203439872:0@lo:400:kworker.0 00010000:00080000:1.0:1787384722.892311:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f4a45f80 x1874208203440384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384722.892321:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203440384:0@lo:400:kworker.0 00000100:00100000:1.0:1787384722.892367:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203439232:0@lo:400:kworker.0 00000100:00100000:3.0:1787384722.892812:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203440768:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787384722.892875:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384722.892899:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874208203440896:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787384722.892951:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384722.892987:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203440896 00000100:00100000:3.0:1787384722.892993:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203440896 00000100:00100000:1.0:1787384722.893240:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203440768 00000100:00100000:1.0:1787384722.893245:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203440768 00000100:00100000:1.0:1787384722.893272:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787384722.893278:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203440768:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787384722.893295:0:17156:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787384722.893337:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203440768:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 57us (462us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787384722.893344:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1787384722.893378:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f87a4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384722.893383:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787384722.893386:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203440768:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787384722.893667:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787384722.893673:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874208203440896:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1787384722.893681:0:17150:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787384722.893932:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874208203440896:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 140us (862us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787384722.893940:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787384722.894766:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8ee0cb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384722.894773:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787384722.894808:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874208203440896:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1787384722.896593:0:3652:0:(import.c:65:import_set_state_nolock()) ffff98f8f5698800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384722.896601:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 551 00000100:00080000:0.0:1787384722.896609:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f8f5698800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384722.896848:0:3652:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f4a45c00 x1874208203441024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384722.896873:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203440000:0@lo:400:kworker.0 00000100:00100000:3.0:1787384722.897313:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203441024:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787384722.897389:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384722.898104:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203441024 00000100:00100000:0.0:1787384722.898112:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203441024 00000100:00100000:0.0:1787384722.898152:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787384722.898159:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874208203441024:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1787384722.898176:0:18681:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787384722.898245:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874208203441024:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 84us (855us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787384722.898252:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1787384722.898524:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f5698800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384722.898536:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787384722.898540:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203441024:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:0.0:1787384722.898712:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787384722.898718:0:19472:0:(genops.c:906:class_export_put()) final put ffff98f7c3a3e800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787384722.898804:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8741dc33-c445-439b-a6e3-d8ded553bb00 00000020:00000080:0.0:1787384722.898807:0:19472:0:(genops.c:906:class_export_put()) final put ffff98f8f87a1800/8741dc33-c445-439b-a6e3-d8ded553bb00 00000020:00000080:3.0:1787384722.899268:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3a3e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787384722.899359:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c3a39800 for lustre-OST0001 00000020:00000080:3.0:1787384722.899469:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f87a1800/8741dc33-c445-439b-a6e3-d8ded553bb00 for lustre-OST0001 00000020:00000080:3.0:1787384722.899491:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c4321800 for lustre-OST0001 00000100:00100000:3.0:1787384722.917683:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874208203440640:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 29399us (29462us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787384722.917712:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000001:00100000:3.0:1787384722.921455:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787384722.921464:0:17130:0:(genops.c:906:class_export_put()) final put ffff98f7c2052000/lustre-MDT0001-mdtlov_UUID 00000100:00080000:2.0:1787384722.921473:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c236d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384722.921482:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787384722.921487:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203440640:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:3.0:1787384722.921496:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 00000001:00080000:3.0:1787384722.921506:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:3.0:1787384722.921509:0:17130:0:(genops.c:906:class_export_put()) final put ffff98f8fde24800/bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 00000001:00100000:3.0:1787384722.921515:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8741dc33-c445-439b-a6e3-d8ded553bb00 00000001:00080000:3.0:1787384722.921520:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:3.0:1787384722.921522:0:17130:0:(genops.c:906:class_export_put()) final put ffff98f7c2368800/8741dc33-c445-439b-a6e3-d8ded553bb00 00000020:00000080:0.0:1787384722.921573:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2052000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787384722.921625:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8fde24800/bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 for lustre-MDT0000 00000020:00000080:0.0:1787384722.921647:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2368800/8741dc33-c445-439b-a6e3-d8ded553bb00 for lustre-MDT0000 00000020:00000080:0.0:1787384722.921667:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c2055000 for lustre-MDT0000 00000020:00000080:0.0:1787384722.921671:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8fde27000 for lustre-MDT0000 00000020:00000080:0.0:1787384722.921674:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c236c000 for lustre-MDT0000 00000020:01000000:2.0:1787384723.254962:0:20723:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f7c201d2a0 - data ffff98f8c9580d80/ffff98f8fde5fc00 00000020:01000000:2.0:1787384723.255166:0:20723:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f7c212d060 - data ffff98f7c24461b0/ffff98f8ee819400 00000040:00080000:1.0:1787384723.256277:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00000004:2.0:1787384723.263127:0:20723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:3.0:1787384723.349696:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787384723.349705:0:20723:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787384723.349719:0:20723:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98f7c42f2680 x1874208203438848/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787384731 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384723.349746:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787384723.352714:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787384723.352722:0:20723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1787384723.352840:0:20723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787384723.352843:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787384723.362047:0:17174:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787384723.362058:0:17174:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1787384723.362076:0:17174:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1787384723.365218:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787384723.365226:0:20723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1787384723.365244:0:20723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787384723.365247:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787384723.365860:0:17176:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787384723.365865:0:17176:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1787384723.365878:0:17176:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1787384723.370272:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba38f5 00000020:00000080:1.0:1787384723.370285:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8f7d40800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787384723.370457:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d40800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787384723.373059:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba390a 00000020:00000080:1.0:1787384723.373072:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8d8044000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787384723.373090:0:20723:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787384723.373095:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384723.373104:0:20723:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787384723.373109:0:20723:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff98f8f1814d40) has no exports 00000020:00000080:3.0:1787384723.373350:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d8044000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1787384723.375520:0:20723:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787384723.375537:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba396c 00000020:00000080:1.0:1787384723.375547:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8efb5b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787384723.375581:0:20723:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787384723.375599:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384723.375609:0:20723:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787384723.375613:0:20723:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff98f8f91f3380) has no exports 00000020:00000080:1.0:1787384723.375621:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3965 00000020:00000080:1.0:1787384723.375625:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8d8044800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787384723.376182:0:20723:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787384723.376187:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787384723.376192:0:20723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1787384723.376199:0:20723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787384723.376215:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787384723.376258:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384723.376265:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787384723.376272:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3957 00000020:00000080:1.0:1787384723.376277:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8d8047800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787384723.376281:0:20723:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787384723.376284:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384723.376287:0:20723:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787384723.376300:0:20723:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff98f8f7d33380) has no exports 00000020:00000080:1.0:1787384723.376305:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3950 00000020:00000080:1.0:1787384723.376309:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8f9132800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787384723.376633:0:20723:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787384723.376637:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787384723.376639:0:20723:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1787384723.376643:0:20723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787384723.376644:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787384723.376667:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384723.376672:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787384723.376683:0:20723:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787384723.376698:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3942 00000020:00000080:1.0:1787384723.376702:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8f9132000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787384723.376706:0:20723:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787384723.376709:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384723.376713:0:20723:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787384723.376715:0:20723:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff98f8f7d30000) has no exports 00000020:00000080:1.0:1787384723.376719:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba393b 00000020:00000080:1.0:1787384723.376721:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8d9148800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787384723.376932:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8efb5b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787384723.376957:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d8044800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787384723.376963:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f9135000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787384723.376968:0:36:0:(genops.c:906:class_export_put()) final put ffff98f8d8042800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787384723.376970:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d8042800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787384723.376975:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787384723.377055:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d8047800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787384723.377059:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f9132800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787384723.377064:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8d8503000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787384723.377067:0:36:0:(genops.c:906:class_export_put()) final put ffff98f8f9136000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787384723.377069:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f9136000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787384723.377073:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787384723.377100:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f9132000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787384723.377105:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d9148800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787384723.381003:0:20723:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787384723.381013:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787384723.381019:0:20723:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787384723.381029:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787384723.381093:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384723.381108:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384723.381156:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384723.381160:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384723.381165:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8d914d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787384723.381171:0:20723:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d914d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787384723.381179:0:20723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384723.381302:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3911 00000020:00000080:0.0:1787384723.381309:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8d8043000/lustre-MDD0000_UUID 00000020:01000000:0.0:1787384723.381315:0:20723:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787384723.381318:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384723.381323:0:20723:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787384723.381328:0:20723:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff98f8f91f4d40) has no exports 00000020:00000080:0.0:1787384723.381346:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384723.381349:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787384723.381353:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3918 00000020:00000080:0.0:1787384723.381357:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8d8043800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787384723.381365:0:20723:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f7d47800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787384723.381368:0:20723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f7d47800 3 00000020:01000004:0.0:1787384723.381371:0:20723:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f8f7d47800 from lustre-MDT0000 00000020:00000080:0.0:1787384723.381387:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384723.381391:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787384723.381394:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8d914e800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787384723.381396:0:20723:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d914e800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787384723.381402:0:20723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787384723.381451:0:20723:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787384723.381455:0:20723:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787384723.381458:0:20723:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787384723.381461:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384723.381463:0:20723:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787384723.381470:0:20723:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98f7c40ad000 57899b24-a33b-4177-9883-79b5fe35053f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787384723.381476:0:20723:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff98f8f54b19c0) has exports, disconnecting them 00000020:00080000:0.0:1787384723.381480:0:20723:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98f7c40ad000), last request at 1787384625 00000020:00000080:0.0:1787384723.381494:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba38bd 00000020:00010000:0.0:1787384723.381498:0:20723:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98f7c40ad000: total 2 00000100:00080000:0.0:1787384723.381502:0:20723:0:(import.c:65:import_set_state_nolock()) ffff98f7c40ac800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787384723.381518:0:20723:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c40ad000): rc 0 00000020:00080000:0.0:1787384723.381521:0:20723:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff98f8f54b19c0) has no exports 00000020:00010000:0.0:1787384723.381533:0:17902:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98f7c40ad000: total 2 00010000:00010000:0.0:1787384723.381556:0:17902:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98f7c40ad000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787384723.381589:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cd600/0x7ef423838fba3e82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba3e7b expref: 14 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381610:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c6140800/0x7ef423838fba39f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba39f1 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381621:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c6141600/0x7ef423838fba3ca6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba3c9f expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381631:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c6140e00/0x7ef423838fba3ce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba3cde expref: 11 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381645:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159a00/0x7ef423838fba3b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba3b17 expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381654:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2091600/0x7ef423838fba3c7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba3c75 expref: 9 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381673:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159200/0x7ef423838fba39dc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba39d5 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381684:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3952a00/0x7ef423838fba3b48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba3b41 expref: 7 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381706:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cce00/0x7ef423838fba3e74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba3e6d expref: 6 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381715:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c6140200/0x7ef423838fba3a99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba3a92 expref: 5 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381723:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c6140400/0x7ef423838fba39ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba39e3 expref: 4 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381733:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902158e00/0x7ef423838fba38cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba38c4 expref: 3 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381746:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2091200/0x7ef423838fba3e66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba3e5f expref: 2 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384723.381756:0:17902:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98f7c40ad000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787384723.381770:0:17902:0:(genops.c:906:class_export_put()) final put ffff98f7c40ad000/57899b24-a33b-4177-9883-79b5fe35053f 00010000:00010000:0.0:1787384723.381774:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384723.381801:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384723.381804:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384723.381899:0:17143:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98f8ee5d2e00:17143] 1 exiting: rc = 0 00000100:00100000:0.0:1787384723.382000:0:17142:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98f8ee5d2c00:17142] 0 exiting: rc = 1 00000100:00100000:3.0:1787384723.382363:0:17144:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98f8ee5d3e00:17144] 2 exiting: rc = 0 00000020:00000080:3.0:1787384723.382417:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f9131000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787384723.382423:0:36:0:(genops.c:906:class_export_put()) final put ffff98f8f54c5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787384723.382426:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f54c5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787384723.382431:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787384723.382484:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d8043000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787384723.382488:0:36:0:(genops.c:906:class_export_put()) final put ffff98f8d8506000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787384723.382490:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d8506000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787384723.382498:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787384723.382525:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d8043800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787384723.382530:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c40ad000/57899b24-a33b-4177-9883-79b5fe35053f for MGS 00000020:00000080:3.0:1787384723.382555:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c40ac800 for MGS 00000100:00100000:0.0:1787384723.382729:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382746:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382752:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382758:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382764:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382770:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382775:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382801:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382807:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382898:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382904:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382909:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382915:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382920:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382925:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382931:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382938:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382943:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382948:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382954:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382960:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382965:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382971:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382977:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382982:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382986:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382991:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.382995:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383000:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383005:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383010:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383015:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383021:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383025:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383030:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383035:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383045:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383050:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383055:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383060:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383065:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383070:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383075:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383080:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383085:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383091:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383096:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383102:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383108:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383114:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383119:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383383:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383392:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383398:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383403:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383408:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383413:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383419:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383424:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383429:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383435:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383440:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383446:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384723.383451:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787384723.392914:0:20723:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f7c36bd600 - data ffff98f8c8e3fca8/ffff98f7c221ec00 00000020:01000000:0.0:1787384723.393069:0:20723:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f7c2b69e40 - data ffff98f7c24c0870/ffff98f8f96cd000 00000020:00000080:0.0:1787384723.394409:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba38a1 00000020:00000080:0.0:1787384723.394421:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8d9b0a800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787384723.394440:0:20723:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f7d47800 from MGS, refs=2 00000020:01000004:0.0:1787384723.394444:0:20723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f7d47800 2 00000020:01000004:0.0:1787384723.394457:0:20723:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f8f7d47800 from MGS 00000020:00000080:0.0:1787384723.394476:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384723.394484:0:20723:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787384723.394487:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8d9b0f800/MGS 00000020:00000080:0.0:1787384723.394490:0:20723:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d9b0f800/MGS for MGS 00000020:01000000:0.0:1787384723.394497:0:20723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787384723.395269:0:20723:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787384723.395275:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384723.395282:0:20723:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787384723.395713:0:20723:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98f8f7d8b000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787384723.395720:0:20723:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff98f7c2898000) has exports, disconnecting them 00000020:00080000:0.0:1787384723.395724:0:20723:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98f8f7d8b000), last request at 1787384625 00000020:00000080:0.0:1787384723.395729:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba39a4 00000020:00080000:0.0:1787384723.395743:0:20723:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f8f7d8b000): rc 0 00000020:00000080:0.0:1787384723.395747:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8f7d8b000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787384723.395973:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d9b0a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787384723.395985:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d8b000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787384723.420546:0:20723:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787384723.420567:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787384723.420571:0:20723:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787384723.420579:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787384723.420620:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f7d8a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787384723.420765:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384723.420774:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787384723.420796:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8f7d89800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787384723.420800:0:20723:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d89800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787384723.420806:0:20723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787384723.421048:0:20723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f7d47800 1 00000020:00000080:3.0:1787384723.421054:0:20723:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3893 00000020:00000080:3.0:1787384723.421060:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8d9b0b000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787384723.421069:0:20723:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787384723.421077:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d9b0b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787384723.421087:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384723.421091:0:20723:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787384723.421094:0:20723:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff98f8f1810000) has no exports 00000020:00000080:3.0:1787384723.565435:0:20723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384723.565449:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787384723.565456:0:20723:0:(genops.c:906:class_export_put()) final put ffff98f8f7d47000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787384723.565461:0:20723:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d47000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787384723.565467:0:20723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787384723.565591:0:20723:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98f8f7d42000 00000020:02000400:3.0:1787384723.565878:0:20723:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787384723.831937:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384724.854897:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384725.882850:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384726.902976:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787384726.979658:0:18652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787384726.979679:0:18652:0:(genops.c:906:class_export_put()) final put ffff98f8d01e4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787384726.979758:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d01e4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787384726.984029:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8d01e6800 for lustre-OST0000 00000020:01000004:0.0:1787384727.511272:0:20924:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787384727.526269:0:20924:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787384727.526327:0:20924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.526343:0:20924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.526352:0:20924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.526359:0:20924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.526400:0:20924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787384727.526406:0:20924:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787384727.526434:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384727.526438:0:20924:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787384727.526444:0:20924:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787384727.526449:0:20924:0:(import.c:65:import_set_state_nolock()) ffff98f8ee0cb000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787384727.526453:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384727.526455:0:20924:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787384727.526458:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787384727.526672:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384727.526680:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384727.526698:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902159600 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:3.0:1787384727.526702:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384727.526711:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384727.526719:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384727.526724:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787384727.526727:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787384727.526729:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787384727.526763:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384727.526770:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384727.526811:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384727.526818:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384727.526841:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384727.526842:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384727.526844:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384727.526853:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384727.526869:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203441152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384727.526932:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384727.527002:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203441152 00000100:00100000:3.0:1787384727.527010:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203441152 00000100:00100000:3.0:1787384727.527048:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787384727.527056:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3654:x1874208203441152:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787384727.527061:0:17137:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787384727 with bad export cookie 9147975791055354045 00010000:00010000:0.0:1787384727.530549:0:20924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.530570:0:20924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.531277:0:20924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.531287:0:20924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.531313:0:20924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384727.531321:0:20924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.531328:0:20924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.531351:0:20924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.531357:0:20924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.532316:0:20924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787384727.532356:0:20924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.532366:0:20924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.532373:0:20924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.532380:0:20924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532496:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787384727.532506:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532513:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a600 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384727.532527:0:17902:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532535:0:17902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384727.532541:0:17902:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384727.532547:0:17902:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787384727.532549:0:17902:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1787384727.532584:0:17902:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532591:0:17902:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384727.532614:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532621:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532649:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384727.532653:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532822:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952400 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384727.532832:0:17902:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532839:0:17902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384727.532856:0:17902:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384727.532862:0:17902:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787384727.532865:0:17902:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787384727.532868:0:17902:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787384727.532884:0:17902:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532890:0:17902:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384727.532905:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532912:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532926:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384727.532930:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532935:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cdc00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384727.532938:0:17902:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532945:0:17902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384727.532951:0:17902:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384727.532967:0:17902:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787384727.532969:0:17902:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787384727.532982:0:17902:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.532988:0:17902:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384727.532994:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384727.533001:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384727.533003:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384727.533005:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384727.533025:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203441408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384727.533094:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384727.533145:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384727.533151:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203441536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384727.533175:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384727.533219:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203441408 00000100:00100000:1.0:1787384727.533226:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203441408 00000100:00100000:1.0:1787384727.533261:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203441536 00000100:00100000:1.0:1787384727.533265:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203441536 00000100:00100000:1.0:1787384727.533279:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384727.533287:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1874208203441408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787384727.533294:0:17135:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787384727 with bad export cookie 9147975791055354045 00000100:00100000:1.0:1787384727.533334:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1874208203441408:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (239us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787384727.533342:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384727.533359:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384727.533370:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8521450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1874208203441536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787384727.533374:0:17135:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787384727 with bad export cookie 9147975791055354045 00000100:00100000:1.0:1787384727.533400:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8521450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1874208203441536:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (223us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787384727.533405:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384727.533427:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384727.533436:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203441280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384727.533458:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787384727.533490:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.145@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787384727.533495:0:3651:0:(import.c:65:import_set_state_nolock()) ffff98f8d914d800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787384727.533499:0:3651:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.145@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1787384727.535390:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384727.539770:0:20924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787384727.539808:0:20924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384727.539836:0:20924:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787384727.539854:0:20924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.539863:0:20924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.539888:0:20924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384727.539896:0:20924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384727.541359:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384727.541369:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384727.541378:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953a00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384727.541396:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384727.541405:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384727.541412:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384727.541417:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787384727.541420:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1787384727.544803:0:20924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1787384727.544819:0:20924:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1787384727.544913:0:20924:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1787384727.544917:0:20924:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1787384727.544967:0:20924:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1787384727.544972:0:20924:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787384727.544977:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384727.544983:0:20924:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787384727.544990:0:20924:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff98f7c236b000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787384727.544997:0:20924:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff98f7c4327000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787384727.545003:0:20924:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff98f8f96899c0) has exports, disconnecting them 00000020:00080000:0.0:1787384727.545007:0:20924:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98f7c236b000), last request at 1787384722 00000020:00000080:0.0:1787384727.545015:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3cd0 00000100:00080000:0.0:1787384727.545036:0:20924:0:(import.c:65:import_set_state_nolock()) ffff98f7c236f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787384727.545172:0:20924:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c236b000): rc 0 00000020:00000080:0.0:1787384727.545175:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f7c236b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1787384727.545186:0:20924:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98f7c4327000), last request at 1787384722 00000020:00000080:0.0:1787384727.545190:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3b72 00000100:00080000:0.0:1787384727.545196:0:20924:0:(import.c:65:import_set_state_nolock()) ffff98f7c4320800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787384727.545203:0:20924:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c4327000): rc 0 00000020:00000080:0.0:1787384727.545205:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f7c4327000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1787384727.545212:0:20924:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffac69414ebae0 00000100:00080000:0.0:1787384727.545244:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384727.545248:0:20924:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787384727.548282:0:20924:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787384727.548293:0:20924:0:(import.c:65:import_set_state_nolock()) ffff98f8f87a4800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787384727.548455:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787384727.548460:0:20924:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787384727.548475:0:20924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787384727.548538:0:20924:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787384727.548566:0:20924:0:(import.c:65:import_set_state_nolock()) ffff98f8d9107000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787384727.548583:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787384727.548586:0:20924:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787384727.548596:0:20924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787384727.548654:0:20924:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787384727.548673:0:20924:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787384727.548708:0:20924:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff98f8f96899c0) has no exports 00000100:00100000:0.0:1787384727.549019:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203441280 00000100:00100000:0.0:1787384727.549027:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203441280 00000100:00100000:0.0:1787384727.549070:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787384727.549078:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3653:x1874208203441280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787384727.549084:0:17135:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787384727 with bad export cookie 9147975791055354045 00000100:00100000:0.0:1787384727.549220:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3653:x1874208203441280:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (15760us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787384727.549229:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787384727.549251:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787384727.551472:0:3651:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.145@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787384727.551479:0:3651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787384727.551489:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f54f8e00 x1874208203441152/t0(0) o103->MGC192.168.203.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787384743 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384727.551504:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8ee117b80 x1874208203441408/t0(0) o103->MGC192.168.203.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787384743 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384727.551513:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8ee115500 x1874208203441536/t0(0) o103->MGC192.168.203.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787384743 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384727.551521:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8ee114000 x1874208203441280/t0(0) o103->MGC192.168.203.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787384743 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787384727.551529:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787384727.551532:0:3651:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787384727.551533:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:2.0:1787384727.552371:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787384727.552386:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c236b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1787384727.552440:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c4327000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1787384727.552460:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c236f000 for lustre-MDT0001 00000020:00000080:2.0:1787384727.552465:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c4320800 for lustre-MDT0001 00000100:00100000:2.0:1787384727.552484:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203441664:0@lo:9:umount.0 00000100:00100000:2.0:1787384727.552554:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384727.552587:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203441792:0@lo:9:umount.0 00000100:00100000:2.0:1787384727.552609:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384727.552655:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203441664 00000100:00100000:2.0:1787384727.552671:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203441664 00000100:00100000:2.0:1787384727.552722:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203441792 00000100:00100000:2.0:1787384727.552725:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203441792 00000100:00100000:2.0:1787384727.552746:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384727.552754:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874208203441664:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787384727.552796:0:18656:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3b9c 00000100:00080000:2.0:1787384727.552805:0:18656:0:(import.c:65:import_set_state_nolock()) ffff98f7c38a8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787384727.552964:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787384727.553272:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3650:x1874208203441664:12345-0@lo:9:umount.0 Request processed in 450us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384727.553281:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384727.553298:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787384727.553305:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874208203441792:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787384727.553318:0:18656:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3d01 00000100:00080000:2.0:1787384727.553324:0:18656:0:(import.c:65:import_set_state_nolock()) ffff98f7c3a3a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787384727.553347:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1787384727.553422:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3650:x1874208203441792:12345-0@lo:9:umount.0 Request processed in 118us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384727.553428:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787384727.553473:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d9107000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787384727.553479:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787384727.553481:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787384727.553485:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203441664:0@lo:9:umount.0 00000100:00080000:2.0:1787384727.553497:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787384727.553500:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787384727.553501:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787384727.553504:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203441792:0@lo:9:umount.0 00010000:00010000:2.0:1787384727.553527:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384727.553532:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384727.553548:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384727.553557:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384727.553571:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384727.553579:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384727.553604:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384727.553606:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384727.553607:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384727.554026:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203441152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384727.554043:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384727.554049:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:0:1874208203441920:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787384727.556164:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384727.556173:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384727.557818:0:3651:0:(import.c:65:import_set_state_nolock()) ffff98f8d914d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384727.557838:0:3651:0:(import.c:510:import_select_connection()) MGC192.168.203.145@tcp: connect to NID 0@lo last attempt 520 00000100:00080000:1.0:1787384727.557847:0:3651:0:(import.c:624:import_select_connection()) MGC192.168.203.145@tcp: import ffff98f8d914d800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384727.557899:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203441280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384727.557955:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8ee114000 x1874208203442048/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384727.557991:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203441408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384727.558004:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203441536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384727.558007:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57899b24-a33b-4177-9883-79b5fe35053f:3650:1874208203442048:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1787384727.558055:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874208203442048 offset 0 length 520: 4 00000400:00000100:3.0:1787384727.558599:0:17137:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874208203441152 offset 224 length 224: 4 00000100:00100000:3.0:1787384727.558613:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3654:x1874208203441152:12345-0@lo:103:ldlm_bl.0 Request processed in 31557us (31680us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787384727.558624:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:00080000:2.0:1787384727.566001:0:20924:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff98f8f96899c0) has no exports 00000020:01000000:3.0:1787384727.627884:0:20924:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f7c36bdf00 - data ffff98f8c9734948/ffff98f7c221f000 00000020:01000000:3.0:1787384727.628041:0:20924:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f8f58c85a0 - data ffff98f8c95c00d8/ffff98f8c6ee0800 00000001:00000004:3.0:1787384727.641930:0:20924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1787384727.707653:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787384727.707672:0:20924:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787384727.707680:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787384727.710218:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787384727.710225:0:20924:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787384727.710240:0:20924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787384727.710242:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787384727.710477:0:17891:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787384727.710482:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1787384727.710510:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787384727.711354:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787384727.711359:0:20924:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787384727.711379:0:20924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787384727.711382:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787384727.711615:0:17893:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787384727.711619:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1787384727.711630:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787384727.712558:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3a06 00000020:00000080:2.0:1787384727.712567:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f7c2057800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787384727.713402:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3a1b 00000020:00000080:2.0:1787384727.713408:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f7c2050000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787384727.713414:0:20924:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1787384727.713429:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384727.713438:0:20924:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787384727.713441:0:20924:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98f8f91f19c0) has no exports 00000004:01000000:2.0:1787384727.713590:0:20924:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787384727.713599:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3a6f 00000020:00000080:2.0:1787384727.713603:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f8f919c800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787384727.713607:0:20924:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787384727.713611:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384727.713616:0:20924:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787384727.713619:0:20924:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff98f8f54b3380) has no exports 00000020:00000080:2.0:1787384727.713623:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3a68 00000020:00000080:2.0:1787384727.713626:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f8f919b800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787384727.714083:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2057800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787384727.714093:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2050000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1787384727.714106:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f919c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787384727.714112:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f919b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787384727.717275:0:20924:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787384727.717284:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787384727.717288:0:20924:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1787384727.717296:0:20924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787384727.717298:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787384727.717355:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384727.717365:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787384727.717373:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3a5a 00000020:00000080:0.0:1787384727.717382:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f8f919b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787384727.717389:0:20924:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787384727.717395:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384727.717400:0:20924:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787384727.717404:0:20924:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff98f8f54b0000) has no exports 00000020:00000080:0.0:1787384727.717411:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3a53 00000020:00000080:0.0:1787384727.717415:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f7c3510000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1787384727.717752:0:20924:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787384727.717755:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787384727.717758:0:20924:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1787384727.717761:0:20924:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787384727.717763:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787384727.717825:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384727.717830:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1787384727.717845:0:20924:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787384727.717852:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3a3e 00000020:00000080:0.0:1787384727.717856:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f8f9439000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787384727.717860:0:20924:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1787384727.717863:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384727.717867:0:20924:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787384727.717869:0:20924:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff98f7c289cd40) has no exports 00000020:00000080:0.0:1787384727.717884:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3a37 00000020:00000080:0.0:1787384727.717887:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f8f87a6800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787384727.718975:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f919a800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787384727.718986:0:36:0:(genops.c:906:class_export_put()) final put ffff98f8f919a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787384727.718989:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f919a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787384727.718995:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787384727.719080:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f919b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787384727.719086:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3510000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787384727.719091:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8d9107000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787384727.719095:0:36:0:(genops.c:906:class_export_put()) final put ffff98f8f943d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787384727.719097:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f943d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1787384727.719100:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787384727.719142:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f9439000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787384727.719147:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f87a6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787384727.766064:0:20924:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1787384727.766075:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787384727.766079:0:20924:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787384727.766088:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787384727.766155:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384727.766184:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787384727.766218:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384727.766222:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787384727.766228:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f8ee358000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787384727.766233:0:20924:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee358000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787384727.766244:0:20924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787384727.766405:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3a22 00000020:00000080:1.0:1787384727.766412:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f7c2054000/lustre-MDD0001_UUID 00000020:01000000:1.0:1787384727.766417:0:20924:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1787384727.766421:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384727.766425:0:20924:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787384727.766429:0:20924:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98f8f968b380) has no exports 00000020:00000080:1.0:1787384727.766446:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384727.766449:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1787384727.766452:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3a29 00000020:00000080:1.0:1787384727.766455:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f7c2054800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1787384727.766462:0:20924:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f7d8f800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1787384727.766465:0:20924:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f7d8f800 2 00000020:01000004:1.0:1787384727.766467:0:20924:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f8f7d8f800 from lustre-MDT0001 00000020:00000080:1.0:1787384727.766485:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384727.766488:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1787384727.766492:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f7c2053800/lustre-MDT0001_UUID 00000020:00000080:1.0:1787384727.766494:0:20924:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2053800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1787384727.766499:0:20924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1787384727.766526:0:20924:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1787384727.766529:0:20924:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1787384727.766532:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384727.766535:0:20924:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787384727.766540:0:20924:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff98f8ee0c8800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787384727.766545:0:20924:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff98f8fc2b4d40) has exports, disconnecting them 00000020:00080000:1.0:1787384727.766549:0:20924:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff98f8ee0c8800), last request at 1787384641 00000020:00000080:1.0:1787384727.766558:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3aa7 00000020:00080000:1.0:1787384727.766572:0:20924:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f8ee0c8800): rc 0 00000020:00000080:1.0:1787384727.766575:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f8ee0c8800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787384727.766908:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f87a4800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787384727.766916:0:36:0:(genops.c:906:class_export_put()) final put ffff98f7c3511800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787384727.766918:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3511800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1787384727.766929:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787384727.767038:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2054000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1787384727.767043:0:36:0:(genops.c:906:class_export_put()) final put ffff98f7c2056800/lustre-MDD0001_UUID 00000020:00000080:2.0:1787384727.767045:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2056800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1787384727.767049:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1787384727.767166:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2054800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787384727.767172:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee0c8800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787384727.804941:0:20924:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787384727.804955:0:20924:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787384727.804960:0:20924:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787384727.804968:0:20924:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787384727.805002:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8ee0cb000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787384727.805139:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787384727.805148:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787384727.805154:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f8ee35c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787384727.805174:0:20924:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee35c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787384727.805185:0:20924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787384727.805262:0:20924:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f7d8f800 1 00000020:00000080:2.0:1787384727.805268:0:20924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba39ce 00000020:00000080:2.0:1787384727.805273:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f8ee359000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787384727.805282:0:20924:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787384727.805290:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee359000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787384727.805299:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384727.805303:0:20924:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787384727.805307:0:20924:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff98f7c289b380) has no exports 00010000:00010000:0.0:1787384727.988613:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787384727.991231:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787384727.991244:0:20924:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787384727.991250:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f8f7d88800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787384727.991254:0:20924:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d88800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787384727.991265:0:20924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787384727.991383:0:20924:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98f8f7d8c800 00000020:01000000:2.0:1787384727.991401:0:20924:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787384727.991405:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384727.991409:0:20924:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787384727.991413:0:20924:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff98f8f18119c0) has no exports 00000100:00080000:0.0:1787384727.991454:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384727.991460:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384727.991463:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384727.991467:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787384727.991471:0:36:0:(import.c:65:import_set_state_nolock()) ffff98f8f5698800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384727.991478:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 617 00000100:00080000:0.0:1787384727.991483:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787384727.991490:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f8f5698800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384727.991530:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f4a45880 x1874208203442176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384727.991606:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203442176:0@lo:38:kworker.0 00000100:00100000:1.0:1787384727.991676:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787384727.996953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384727.996965:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787384727.996969:0:36:0:(import.c:65:import_set_state_nolock()) ffff98f7c236d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384727.996977:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 617 00000100:00080000:0.0:1787384727.996983:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787384727.996989:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f7c236d800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384727.997031:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f4a47480 x1874208203442432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384727.997093:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203442432:0@lo:38:kworker.0 00000100:00100000:0.0:1787384727.997155:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384727.997198:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384727.997208:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203442304:0@lo:400:kworker.0 00000100:00100000:0.0:1787384727.997249:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384727.998544:0:18681:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff98f7c2b1f400:18681] 3 exiting: rc = 0 00000100:00100000:1.0:1787384727.998741:0:17152:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff98f7c427cc00:17152] 2 exiting: rc = 0 00000100:00100000:0.0:1787384727.999930:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203442560:0@lo:400:kworker.0 00000100:00100000:0.0:1787384727.999996:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384728.002150:0:17151:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff98f7c427ca00:17151] 1 exiting: rc = 0 00000100:00100000:2.0:1787384728.010274:0:17150:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff98f7c206a800:17150] 0 exiting: rc = 1 00000100:00100000:2.0:1787384728.010433:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010442:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010447:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010453:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010460:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010465:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010472:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010478:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010483:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010491:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010497:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010518:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010523:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010529:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010534:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010539:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010545:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010550:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010555:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010561:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010566:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010571:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010576:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010581:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010586:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010590:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010595:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010601:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010607:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010613:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010618:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010624:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010629:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010634:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010639:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010645:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010650:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010665:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010685:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010692:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010698:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010703:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010708:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010713:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.010719:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013223:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013419:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013428:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013434:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013440:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013445:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013451:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013457:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013461:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013466:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013471:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013476:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013480:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013485:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013490:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013495:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013502:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013509:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.013514:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.029525:0:17153:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98f8fc180000:17153] 0 exiting: rc = 1 00000100:00100000:3.0:1787384728.029697:0:17154:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98f8fc180e00:17154] 1 exiting: rc = 0 00000100:00100000:0.0:1787384728.029978:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.029988:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.029995:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030002:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030008:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030013:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030018:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030024:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030030:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030037:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030043:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030048:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030054:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030059:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030065:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030070:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030076:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030081:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030086:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030091:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030097:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030104:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030110:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030115:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030120:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030125:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030130:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030135:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030141:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030165:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030170:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030175:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030180:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030185:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030191:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030196:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030201:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030206:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030212:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030218:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030223:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030229:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030235:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030240:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030246:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030252:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030326:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030334:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030339:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030345:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030351:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030356:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030362:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030367:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030372:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030377:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030382:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030387:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030393:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030398:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030403:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030408:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030413:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.030418:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384728.031729:0:17156:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98f8e8a7a800:17156] 1 exiting: rc = 0 00000100:00100000:3.0:1787384728.032389:0:17155:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff98f8e8a7b000:17155] 0 exiting: rc = 1 00000100:00100000:0.0:1787384728.033672:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033682:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033689:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033695:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033701:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033708:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033714:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033720:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033726:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033751:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033758:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033764:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033769:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033775:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033802:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033810:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033815:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033821:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033826:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033832:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033838:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033860:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033867:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033873:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033879:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033885:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033890:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033897:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033903:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033911:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033918:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033925:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033934:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033955:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033963:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033982:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033988:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.033995:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034001:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034007:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034013:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034019:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034024:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034030:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034036:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034056:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034064:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034070:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034075:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034081:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034086:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034092:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034098:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034104:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034109:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034127:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034134:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034154:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034160:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034166:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034171:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034178:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034183:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.034189:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.049668:0:17157:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98f8e8a7a000:17157] 0 exiting: rc = 1 00000100:00100000:2.0:1787384728.050043:0:17158:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98f8e8a7bc00:17158] 1 exiting: rc = 0 00000100:00100000:3.0:1787384728.050140:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050156:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050162:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050168:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050173:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050179:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050184:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050189:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050194:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050199:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050204:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050209:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050213:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050218:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050222:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050227:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050246:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050251:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050256:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050260:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050265:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050270:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050275:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050280:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050285:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050289:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050294:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050298:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050303:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050307:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050312:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050316:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050321:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050325:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050331:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050336:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050340:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050345:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050349:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050354:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050359:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050363:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050368:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050372:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050377:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050382:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050386:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050390:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050395:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050400:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050404:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050413:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050418:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050423:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050428:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050432:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050437:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050441:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050446:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050450:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050455:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050459:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050463:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384728.050468:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.051125:0:17159:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98f8e8a7b400:17159] 0 exiting: rc = 1 00000100:00100000:0.0:1787384728.054527:0:17160:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98f8e8a7b600:17160] 1 exiting: rc = 0 00000100:00100000:2.0:1787384728.062579:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062589:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062594:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062601:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062606:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062612:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062617:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062622:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062627:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062632:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062638:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062644:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062649:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062665:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062672:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062695:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062701:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062706:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062712:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062727:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062733:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062739:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062744:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062750:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062756:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062761:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062767:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062772:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062793:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062800:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062806:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062811:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062816:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062822:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062827:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062833:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062838:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062843:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062849:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062854:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062859:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062863:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062869:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062874:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062878:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062884:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062889:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062893:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062898:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062903:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062915:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062921:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062926:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062931:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062935:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062941:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062945:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062951:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062956:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062961:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062966:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062971:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062976:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.062981:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384728.063397:0:17161:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff98f8f9196400:17161] 0 exiting: rc = 1 00000100:00100000:0.0:1787384728.063805:0:17162:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff98f8f9196800:17162] 1 exiting: rc = 0 00000100:00100000:2.0:1787384728.064647:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064664:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064678:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064684:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064690:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064695:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064701:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064706:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064711:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064716:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064730:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064736:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064742:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064748:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064753:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064758:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064764:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064769:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064774:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064794:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064800:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064818:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064823:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064828:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064832:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064837:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064843:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064848:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064853:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064858:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064863:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064868:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064873:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064878:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064883:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064889:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064894:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064900:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064905:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064911:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064917:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064923:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064928:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064933:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064938:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064943:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064948:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064954:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064960:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064965:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064970:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064976:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064981:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064987:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064992:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.064997:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.065010:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.065026:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.065033:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.065039:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.065044:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.065050:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.065056:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.065062:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384728.066044:0:17165:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff98f8f56b7200:17165] 2 exiting: rc = 0 00000100:00100000:1.0:1787384728.067545:0:17163:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff98f8f56b6a00:17163] 0 exiting: rc = 1 00000100:00100000:1.0:1787384728.067762:0:17164:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff98f8f56b6800:17164] 1 exiting: rc = 0 00000100:00100000:2.0:1787384728.067916:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067923:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067929:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067935:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067941:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067947:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067952:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067958:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067965:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067970:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067975:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067981:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067986:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067991:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.067996:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068002:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068007:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068013:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068019:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068024:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068050:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068056:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068061:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068065:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068070:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068075:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068080:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068099:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068104:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068109:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068114:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068120:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068125:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068130:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068136:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068141:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068146:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068152:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068157:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068162:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068167:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068173:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068178:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068184:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068204:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068209:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068215:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068221:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068227:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068233:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068240:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068246:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068252:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068258:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068263:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068268:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068273:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068279:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068284:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068290:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068295:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068300:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068315:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384728.068321:0:20924:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787384728.081083:0:20924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384728.081095:0:20924:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787384728.081101:0:20924:0:(genops.c:906:class_export_put()) final put ffff98f8d914f000/MDS_uuid 00000020:00000080:3.0:1787384728.081106:0:20924:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d914f000/MDS_uuid for MDS 00000020:01000000:3.0:1787384728.081118:0:20924:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787384728.081258:0:20924:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1787384729.016004:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384730.039922:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384731.070268:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787384731.828506:0:21124:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787384731.839112:0:21124:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787384731.839167:0:21124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384731.839182:0:21124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384731.839188:0:21124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384731.839195:0:21124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384731.839220:0:21124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787384731.839237:0:21124:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787384731.839260:0:21124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787384731.839271:0:21124:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a45880 x1874208203442176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384742 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384731.839288:0:21124:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787384731.839293:0:21124:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787384731.839299:0:21124:0:(import.c:65:import_set_state_nolock()) ffff98f8f5698800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787384731.839303:0:21124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787384731.839306:0:21124:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a45880 x1874208203442176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384742 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384731.839313:0:21124:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787384731.839316:0:21124:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:1.0:1787384731.839336:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384731.839344:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384731.839352:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a000 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384731.839356:0:17902:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384731.839364:0:17902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384731.839371:0:17902:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384731.839376:0:17902:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787384731.839379:0:17902:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787384731.839381:0:17902:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787384731.839401:0:17902:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8d914d800 00010000:00010000:1.0:1787384731.839405:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384731.839412:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384731.839422:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384731.839424:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384731.839425:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384731.841841:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203442176:0@lo:38:kworker.0 00000100:00080000:3.0:1787384731.842711:0:21124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787384731.842729:0:21124:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a44380 x1874208203442304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384743 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384731.842762:0:21124:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787384731.842767:0:21124:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787384731.842807:0:21124:0:(import.c:65:import_set_state_nolock()) ffff98f7c40d4000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787384731.842869:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874208203442688:0@lo:39:umount.0 00000400:00000100:2.0:1787384731.842927:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203442688 offset 0 length 224: 4 00000100:00100000:1.0:1787384731.846740:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203442304:0@lo:400:kworker.0 00000100:00080000:0.0:1787384732.023572:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384732.023596:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384732.023599:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384732.023602:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787384732.023688:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203442816:0@lo:400:kworker.0 00000400:00000100:1.0:1787384732.023737:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203442816 offset 0 length 224: 4 00010000:00010000:2.0:1787384732.087248:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787384733.047110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384733.047121:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384733.047124:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384733.047127:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787384733.047301:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203442944:0@lo:400:kworker.0 00000400:00000100:1.0:1787384733.047360:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203442944 offset 0 length 224: 4 00010000:00010000:2.0:1787384733.111459:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787384733.114555:0:18652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787384733.114563:0:18652:0:(genops.c:906:class_export_put()) final put ffff98f7c38ae800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787384733.114817:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c38ae800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787384733.114867:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c38a8000 for lustre-OST0000 00000001:00100000:1.0:1787384733.115667:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787384733.115672:0:19472:0:(genops.c:906:class_export_put()) final put ffff98f7c3a3d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787384733.116299:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3a3d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787384733.116342:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c3a3a800 for lustre-OST0001 00010000:00010000:1.0:1787384734.135010:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384735.159088:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384736.185276:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384737.208989:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384737.974956:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384727/real 1787384727] req@ffff98f8ee114000 x1874208203442048/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787384737 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384737.974991:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8ee114000 x1874208203442048/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787384737 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384737.975012:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d914d800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384737.975220:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787384737.975225:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57899b24-a33b-4177-9883-79b5fe35053f:3650:1874208203442048:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1787384737.975680:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384737.975686:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787384737.975689:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8d914d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384737.975694:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.145@tcp: connect to NID 0@lo last attempt 622 00000100:00080000:0.0:1787384737.975700:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.145@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787384737.975707:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.145@tcp: import ffff98f8d914d800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384737.975739:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f4a44a80 x1874208203443072/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787384737.976044:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57899b24-a33b-4177-9883-79b5fe35053f:3650:1874208203443072:0@lo:250:kworker.0 00000400:00000100:2.0:1787384737.976088:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874208203443072 offset 0 length 520: 4 00000100:00080000:0.0:1787384737.976141:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384737.976145:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787384737.976327:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203443200:0@lo:400:kworker.0 00000400:00000100:1.0:1787384737.976353:0:3654:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203443200 offset 0 length 224: 4 00010000:00010000:2.0:1787384738.233899:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384739.255227:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384740.279235:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384741.046906:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384731/real 1787384731] req@ffff98f8f54f8000 x1874208203442688/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787384741 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384741.046970:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f54f8000 x1874208203442688/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787384741 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384741.046989:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c40d4000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787384741.047008:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874208203442688:0@lo:39:umount.0 00000100:00080000:3.0:1787384741.047212:0:21124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787384741.047217:0:21124:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787384741.047221:0:21124:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787384741.048710:0:21124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384741.048729:0:21124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384741.048753:0:21124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384741.048761:0:21124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384741.049919:0:21124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384741.050230:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384741.050238:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384741.050322:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ac00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384741.050327:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384741.050336:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384741.050342:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384741.050348:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787384741.050351:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1787384741.050361:0:17139:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8d914d800 00010000:00010000:2.0:1787384741.050365:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384741.050371:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384741.050402:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384741.050405:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384741.050406:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384741.050436:0:21124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384741.050445:0:21124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384741.050451:0:21124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384741.050457:0:21124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384741.050474:0:21124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787384741.050478:0:21124:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1787384741.050482:0:21124:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787384741.050515:0:21124:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787384741.050520:0:21124:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787384741.050527:0:21124:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384741.050533:0:21124:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787384741.050537:0:21124:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff98f8f593b380) has no exports 00000020:00080000:3.0:1787384741.051876:0:21124:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff98f8f593b380) has no exports 00010000:00010000:2.0:1787384741.052177:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384741.052185:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384741.052197:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc000 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384741.052201:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384741.052212:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384741.052220:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384741.052226:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787384741.052229:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787384741.052233:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787384741.053323:0:17138:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8d914d800 00010000:00010000:2.0:1787384741.053332:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384741.053343:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384741.053360:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384741.053363:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384741.053382:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787384741.058198:0:21124:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f7c201de40 - data ffff98f8d17df438/ffff98f8fde5dc00 00000020:01000000:3.0:1787384741.058471:0:21124:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f8c614a240 - data ffff98f8c9583288/ffff98f7c28ab800 00100000:10000000:3.0:1787384741.069648:0:21124:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787384741.077119:0:21124:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3b2c 00000020:00000080:0.0:1787384741.077131:0:21124:0:(genops.c:906:class_export_put()) final put ffff98f7c4324800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787384741.077182:0:21124:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8d9698000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787384741.077198:0:21124:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8d9698000 2 00000020:01000004:0.0:1787384741.077201:0:21124:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f8d9698000 from lustre-OST0000 00000020:00000080:0.0:1787384741.077226:0:21124:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384741.077236:0:21124:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787384741.077240:0:21124:0:(genops.c:906:class_export_put()) final put ffff98f8d01e0000/lustre-OST0000_UUID 00000020:00000080:0.0:1787384741.077243:0:21124:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d01e0000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787384741.077250:0:21124:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787384741.077299:0:21124:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787384741.077303:0:21124:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787384741.077306:0:21124:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384741.077310:0:21124:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787384741.077316:0:21124:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98f7c40d2000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787384741.077321:0:21124:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff98f8fc2b0000) has exports, disconnecting them 00000020:00080000:0.0:1787384741.077326:0:21124:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98f7c40d2000), last request at 1787384655 00000020:00000080:0.0:1787384741.077329:0:21124:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3b56 00000020:00080000:0.0:1787384741.077338:0:21124:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c40d2000): rc 0 00000020:00000080:0.0:1787384741.077343:0:21124:0:(genops.c:906:class_export_put()) final put ffff98f7c40d2000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787384741.077364:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c4324800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787384741.078746:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c40d2000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787384741.079924:0:21124:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787384741.079931:0:21124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787384741.079936:0:21124:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787384741.079943:0:21124:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787384741.080073:0:21124:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384741.080094:0:21124:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787384741.080102:0:21124:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787384741.080107:0:21124:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384741.080112:0:21124:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787384741.080119:0:21124:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff98f7c40d1000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787384741.080125:0:21124:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff98f8f9688000) has exports, disconnecting them 00000020:00080000:1.0:1787384741.080130:0:21124:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff98f7c40d1000), last request at 1787384655 00000020:00000080:1.0:1787384741.080134:0:21124:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3b6b 00000020:00080000:1.0:1787384741.080149:0:21124:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c40d1000): rc 0 00000020:00000080:1.0:1787384741.080154:0:21124:0:(genops.c:906:class_export_put()) final put ffff98f7c40d1000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787384741.080574:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f5698800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787384741.080582:0:37:0:(genops.c:906:class_export_put()) final put ffff98f7c38a9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787384741.080584:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c38a9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787384741.080590:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787384741.080669:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c40d1000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1787384741.137071:0:21124:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787384741.137080:0:21124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787384741.137083:0:21124:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787384741.137090:0:21124:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787384741.137123:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c40d4000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787384741.137287:0:21124:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384741.137296:0:21124:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787384741.137302:0:21124:0:(genops.c:906:class_export_put()) final put ffff98f7c40d7800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787384741.137305:0:21124:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c40d7800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787384741.137317:0:21124:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1787384741.137383:0:21124:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8d9698000 1 00000020:00000080:3.0:1787384741.137389:0:21124:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3b09 00000020:00000080:3.0:1787384741.137395:0:21124:0:(genops.c:906:class_export_put()) final put ffff98f8f87a2800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787384741.137404:0:21124:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787384741.137412:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f87a2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787384741.137421:0:21124:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384741.137426:0:21124:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787384741.137429:0:21124:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff98f8f7d34d40) has no exports 00000020:00000080:3.0:1787384741.176301:0:21124:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384741.176323:0:21124:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787384741.176328:0:21124:0:(genops.c:906:class_export_put()) final put ffff98f8d9699800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787384741.176332:0:21124:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d9699800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787384741.176343:0:21124:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787384741.176438:0:21124:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98f8d969e000 00000020:02000400:3.0:1787384741.176480:0:21124:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787384741.303937:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384742.072907:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384727/real 1787384727] req@ffff98f8f4a47480 x1874208203442432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787384742 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384742.072936:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f4a47480 x1874208203442432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787384742 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384742.072955:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c236d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384742.072982:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787384742.072987:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203442432:0@lo:38:kworker.0 00000100:00080000:0.0:1787384742.073064:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384742.073070:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384742.073073:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384742.073076:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787384742.073079:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f7c236d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384742.073085:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 623 00000100:00080000:0.0:1787384742.073089:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787384742.073096:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f7c236d800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384742.073127:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f4a45500 x1874208203443328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384742.073202:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203443456:0@lo:400:kworker.0 00000400:00000100:0.0:1787384742.073255:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203443456 offset 0 length 224: 4 00000100:00100000:2.0:1787384742.073357:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203443328:0@lo:38:kworker.0 00000400:00000100:2.0:1787384742.073378:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203443328 offset 0 length 520: 4 00010000:00010000:2.0:1787384742.331508:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787384743.095993:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384743.096002:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384743.096005:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384743.096008:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787384743.096069:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203443584:0@lo:400:kworker.0 00000400:00000100:0.0:1787384743.096129:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203443584 offset 0 length 224: 4 00000100:00000400:2.0:1787384743.098919:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384727/real 1787384728] req@ffff98f8f4a44700 x1874208203442560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787384743 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384743.129076:0:3651:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff98f8f4a44700 x1874208203442560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787384743 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384743.129090:0:3651:0:(import.c:65:import_set_state_nolock()) ffff98f7c40d5000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787384743.129095:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787384743.141628:0:3651:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1787384743.143418:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787384743.143427:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57899b24-a33b-4177-9883-79b5fe35053f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787384743.143430:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787384743.143434:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787384743.143437:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787384743.143440:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787384743.143443:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f7c40d5000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384743.143452:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 566 00000100:00080000:3.0:1787384743.143462:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98f7c40d5000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384743.143503:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f54fbb80 x1874208203443712/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384743.144630:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874208203443712:0@lo:38:kworker.0 00000400:00000100:1.0:1787384743.144683:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203443712 offset 0 length 520: 4 00000100:00100000:3.0:1787384743.145914:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203442560:0@lo:400:kworker.0 00010000:00010000:2.0:1787384743.350936:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384744.375043:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787384744.839233:0:21327:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787384744.850085:0:21327:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787384744.850169:0:21327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384744.850184:0:21327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384744.850193:0:21327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384744.850201:0:21327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384744.850225:0:21327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787384744.850231:0:21327:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787384744.850251:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787384744.850273:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a45500 x1874208203443328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384762 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.850292:0:21327:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787384744.850298:0:21327:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787384744.850303:0:21327:0:(import.c:65:import_set_state_nolock()) ffff98f7c236d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787384744.850308:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787384744.850311:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a45500 x1874208203443328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384762 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.850318:0:21327:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787384744.850321:0:21327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:2.0:1787384744.850360:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384744.850368:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384744.850376:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cca00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384744.850380:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384744.850395:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384744.850402:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384744.850408:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787384744.850410:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787384744.850412:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787384744.850424:0:17139:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8d914d800 00010000:00010000:2.0:1787384744.850428:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384744.850434:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384744.850444:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384744.850446:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384744.850448:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384744.850565:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203443328:0@lo:38:kworker.0 00000100:00080000:1.0:1787384744.851679:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787384744.851689:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a44380 x1874208203442816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384748 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.851754:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a45880 x1874208203442944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384749 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.851772:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a46680 x1874208203443200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384753 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.851817:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a47800 x1874208203443456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384758 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.851829:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a46d80 x1874208203443584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384759 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.851838:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f54fbb80 x1874208203443712/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384753 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.851847:0:21327:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787384744.851852:0:21327:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787384744.851857:0:21327:0:(import.c:65:import_set_state_nolock()) ffff98f7c40d5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787384744.851860:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787384744.851889:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a44380 x1874208203442816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384748 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384744.851960:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203442944:0@lo:400:kworker.0 00000100:00100000:0.0:1787384744.852035:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203443200:0@lo:400:kworker.0 00000100:00100000:2.0:1787384744.852807:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203442816:0@lo:400:kworker.0 00000100:00100000:1.0:1787384744.853143:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a45880 x1874208203442944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384749 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.853162:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a46680 x1874208203443200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384753 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.853169:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a47800 x1874208203443456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384758 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.853177:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a46d80 x1874208203443584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384759 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.853185:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f54fbb80 x1874208203443712/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384753 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384744.853191:0:21327:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787384744.853262:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203443456:0@lo:400:kworker.0 00000100:00100000:3.0:1787384744.853290:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874208203443712:0@lo:38:kworker.0 00000100:00100000:2.0:1787384744.855622:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203443584:0@lo:400:kworker.0 00000100:00100000:1.0:1787384744.855659:0:21327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787384744.856761:0:21327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384744.856775:0:21327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384744.857064:0:21327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384744.857071:0:21327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384744.857118:0:21327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384744.857126:0:21327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384744.857327:0:21327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384744.857335:0:21327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384744.857340:0:21327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384744.857366:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384744.857372:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384744.857379:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141e00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384744.857383:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384744.857396:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384744.857403:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384744.857409:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787384744.857411:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1787384744.857420:0:17138:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8d914d800 00010000:00010000:2.0:1787384744.857424:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384744.857430:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384744.857443:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384744.857446:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384744.857450:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384744.857453:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384744.857460:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384744.857466:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384744.857479:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787384744.857481:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787384744.857484:0:17138:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8d914d800 00010000:00010000:2.0:1787384744.857487:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384744.857493:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384744.857494:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384744.857496:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384744.857555:0:21327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787384744.857559:0:21327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384744.857572:0:21327:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787384744.857577:0:21327:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1787384744.857579:0:21327:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787384744.857603:0:21327:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787384744.857606:0:21327:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787384744.857611:0:21327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384744.857616:0:21327:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787384744.857620:0:21327:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff98f8f968cd40) has no exports 00000020:00080000:1.0:1787384744.857639:0:21327:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff98f8f968cd40) has no exports 00010000:00010000:3.0:1787384744.859325:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787384744.860177:0:21327:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f7c3a249c0 - data ffff98f8c943a6c0/ffff98f8f0fca000 00000020:01000000:1.0:1787384744.860321:0:21327:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f8fd2450c0 - data ffff98f8c9573870/ffff98f8f0fea800 00100000:10000000:1.0:1787384744.874290:0:21327:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787384744.879228:0:21327:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3c8a 00000020:00000080:3.0:1787384744.879240:0:21327:0:(genops.c:906:class_export_put()) final put ffff98f8f569b800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787384744.879296:0:21327:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8ee0ca000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787384744.879300:0:21327:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8ee0ca000 2 00000020:01000004:3.0:1787384744.879303:0:21327:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f8ee0ca000 from lustre-OST0001 00000020:00000080:3.0:1787384744.879324:0:21327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384744.879345:0:21327:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787384744.879348:0:21327:0:(genops.c:906:class_export_put()) final put ffff98f7c40d1800/lustre-OST0001_UUID 00000020:00000080:3.0:1787384744.879351:0:21327:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c40d1800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787384744.879358:0:21327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787384744.879448:0:21327:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 57899b24-a33b-4177-9883-79b5fe35053f->MGS 00010000:00010000:3.0:1787384744.879463:0:21327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3953c00/0x7ef423838fba39d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba39dc expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384744.879475:0:21327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3953c00/0x7ef423838fba39d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba39dc expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384744.879481:0:21327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787384744.879483:0:21327:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787384744.879486:0:21327:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787384744.879499:0:21327:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8d914d800 00010000:00010000:3.0:1787384744.879503:0:21327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3953c00/0x7ef423838fba39d5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba39dc expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384744.879518:0:21327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384744.879524:0:21327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384744.879552:0:21327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787384744.879554:0:21327:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787384744.879556:0:21327:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787384744.879566:0:21327:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8d914d800 00010000:00010000:3.0:1787384744.879568:0:21327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787384744.879585:0:21327:0:(import.c:65:import_set_state_nolock()) ffff98f8d914d800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787384744.879589:0:21327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787384744.879592:0:21327:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787384744.879593:0:21327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787384744.879597:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787384744.879608:0:21327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f4a44a80 x1874208203443072/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787384752 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787384744.879629:0:21327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787384744.879632:0:21327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:2.0:1787384744.879818:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57899b24-a33b-4177-9883-79b5fe35053f:3650:1874208203443072:0@lo:250:kworker.0 10000000:01000000:3.0:1787384744.879995:0:21327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787384744.880002:0:21327:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba38af 00000020:00000080:3.0:1787384744.880007:0:21327:0:(genops.c:906:class_export_put()) final put ffff98f8d914e000/57899b24-a33b-4177-9883-79b5fe35053f 00000020:00000080:1.0:1787384744.880204:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f569b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787384744.880275:0:21327:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.145@tcp (flags='') 00000020:00000080:3.0:1787384744.880281:0:21327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384744.880287:0:21327:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.145@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787384744.880290:0:21327:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff98f8f1813380) has no exports 00000020:00000080:1.0:1787384744.880346:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d914e000/57899b24-a33b-4177-9883-79b5fe35053f for MGC192.168.203.145@tcp 10000000:01000000:2.0:1787384744.880495:0:17146:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787384744.880657:0:21327:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.145@tcp: client import never connected 00000100:00080000:3.0:1787384744.880660:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787384744.880722:0:21327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787384744.880726:0:21327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787384744.880728:0:21327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787384744.880772:0:21327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384744.880842:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8d914d800 for MGC192.168.203.145@tcp 00000020:00000080:3.0:1787384744.880896:0:21327:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.145@tcp (uuid 57899b24-a33b-4177-9883-79b5fe35053f) 00000020:00000080:3.0:1787384744.880899:0:21327:0:(genops.c:906:class_export_put()) final put ffff98f8f7d42800/57899b24-a33b-4177-9883-79b5fe35053f 00000020:00000080:3.0:1787384744.880907:0:21327:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d42800/57899b24-a33b-4177-9883-79b5fe35053f for MGC192.168.203.145@tcp 00000020:01000000:3.0:1787384744.880911:0:21327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.145@tcp (57899b24-a33b-4177-9883-79b5fe35053f) 00000020:01000000:3.0:1787384744.881144:0:21327:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787384744.881148:0:21327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384744.881153:0:21327:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787384744.881158:0:21327:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98f7c236e000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787384744.881163:0:21327:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff98f8fc2b19c0) has exports, disconnecting them 00000020:00080000:3.0:1787384744.881167:0:21327:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98f7c236e000), last request at 1787384671 00000020:00000080:3.0:1787384744.881171:0:21327:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3cb4 00000020:00080000:3.0:1787384744.881183:0:21327:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c236e000): rc 0 00000020:00000080:3.0:1787384744.881187:0:21327:0:(genops.c:906:class_export_put()) final put ffff98f7c236e000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787384744.882033:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c236e000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787384744.882929:0:21327:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787384744.882935:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787384744.882939:0:21327:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787384744.882945:0:21327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787384744.883072:0:21327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787384744.883080:0:21327:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787384744.883086:0:21327:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787384744.883090:0:21327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384744.883093:0:21327:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787384744.883099:0:21327:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff98f7c222d800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787384744.883104:0:21327:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff98f7c211b380) has exports, disconnecting them 00000020:00080000:2.0:1787384744.883109:0:21327:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff98f7c222d800), last request at 1787384671 00000020:00000080:2.0:1787384744.883112:0:21327:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3cc9 00000020:00080000:2.0:1787384744.883126:0:21327:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c222d800): rc 0 00000020:00000080:2.0:1787384744.883131:0:21327:0:(genops.c:906:class_export_put()) final put ffff98f7c222d800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1787384744.883728:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c236d800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787384744.883738:0:37:0:(genops.c:906:class_export_put()) final put ffff98f7c3540800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787384744.883740:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3540800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787384744.883746:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787384744.883824:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c222d800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787384744.897765:0:21327:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787384744.897836:0:21327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787384744.897841:0:21327:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787384744.897848:0:21327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787384744.897973:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787384744.898093:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:1.0:1787384744.898177:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c40d5000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787384744.900836:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787384744.901082:0:17133:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98f8c713b000:17133] 0 exiting: rc = 1 00000100:00100000:2.0:1787384744.901181:0:17134:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98f8cb1eea00:17134] 1 exiting: rc = 0 00000100:00100000:1.0:1787384744.901283:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.901524:0:17136:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98f7c3851000:17136] 1 exiting: rc = 0 00000100:00100000:1.0:1787384744.901598:0:19489:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98f8c6f02400:19489] 3 exiting: rc = 0 00000100:00100000:2.0:1787384744.901702:0:17135:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98f7c3850000:17135] 0 exiting: rc = 1 00000100:00100000:3.0:1787384744.902093:0:17137:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98f7c427d400:17137] 2 exiting: rc = 0 00000100:00100000:1.0:1787384744.902185:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902192:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902198:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902203:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902209:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902214:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902221:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902227:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902233:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902238:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902242:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902248:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902254:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902258:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902262:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902266:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902271:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902276:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902281:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902286:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902291:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902307:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902312:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902317:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902322:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902328:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902333:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902338:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902343:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902348:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902353:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902359:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902364:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902368:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902373:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902378:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902383:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902389:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902394:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902399:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902405:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902410:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902415:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902421:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902426:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902432:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902436:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902441:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902446:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902451:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902457:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902462:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902467:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902472:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902477:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902483:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902496:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902502:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902507:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902517:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902523:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902528:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902534:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.902549:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787384744.903282:0:21327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384744.903293:0:21327:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787384744.903298:0:21327:0:(genops.c:906:class_export_put()) final put ffff98f8f9137800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787384744.903302:0:21327:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f9137800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787384744.903307:0:21327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787384744.903352:0:21327:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8ee0ca000 1 00000020:00000080:1.0:1787384744.903358:0:21327:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3c6e 00000020:00000080:1.0:1787384744.903364:0:21327:0:(genops.c:906:class_export_put()) final put ffff98f7c3541800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787384744.903414:0:21327:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787384744.903419:0:21327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384744.903423:0:21327:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787384744.903427:0:21327:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff98f8fc2b3380) has no exports 00000020:00000080:2.0:1787384744.904818:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3541800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787384744.922947:0:21327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384744.922961:0:21327:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787384744.922967:0:21327:0:(genops.c:906:class_export_put()) final put ffff98f7c3545000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787384744.922976:0:21327:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3545000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787384744.922987:0:21327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787384744.923355:0:21327:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98f8ee0cf000 00000020:01000000:1.0:1787384744.923374:0:21327:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787384744.923379:0:21327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384744.923383:0:21327:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787384744.923387:0:21327:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff98f8f7d319c0) has no exports 00000020:00000080:1.0:1787384744.923410:0:21327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384744.923415:0:21327:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787384744.923418:0:21327:0:(genops.c:906:class_export_put()) final put ffff98f8f87a4000/OSS_uuid 00000020:00000080:1.0:1787384744.923428:0:21327:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f87a4000/OSS_uuid for OSS 00000020:01000000:1.0:1787384744.923432:0:21327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787384744.923650:0:17145:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787384744.923944:0:18658:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff98f8d9460200:18658] 2 exiting: rc = 0 00000100:00100000:2.0:1787384744.924987:0:19186:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98f7c108a800:19186] 3 exiting: rc = 0 00000100:00100000:2.0:1787384744.925062:0:18657:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98f8d9461c00:18657] 1 exiting: rc = 0 00000100:00100000:2.0:1787384744.925111:0:18656:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff98f8cb3d6e00:18656] 0 exiting: rc = 1 00000100:00100000:1.0:1787384744.925295:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925303:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925308:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925313:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925318:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925327:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925333:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925337:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925342:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925347:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925353:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925358:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925363:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925369:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925374:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925379:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925384:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925388:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925393:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925397:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925402:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925407:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925413:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925418:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925423:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925428:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925433:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925438:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925444:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925449:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925465:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925472:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925478:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925493:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925497:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925501:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925505:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925510:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925514:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925519:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925523:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925527:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925532:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925537:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925553:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925560:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925564:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925571:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925576:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925581:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925586:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925592:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925597:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925603:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925609:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925614:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925619:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925625:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925630:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925635:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925641:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925646:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925651:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.925657:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384744.927611:0:19944:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff98f7c3b07e00:19944] 2 exiting: rc = 0 00000100:00100000:0.0:1787384744.927709:0:18659:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98f8d9460000:18659] 0 exiting: rc = 1 00000100:00100000:2.0:1787384744.927901:0:18660:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98f8d9461800:18660] 1 exiting: rc = 0 00000100:00100000:1.0:1787384744.928225:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928233:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928239:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928244:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928262:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928268:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928273:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928279:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928284:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928290:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928295:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928301:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928307:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928312:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928316:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928322:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928327:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928331:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928336:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928341:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928346:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928350:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928354:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928358:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928363:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928368:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928372:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928376:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928381:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928385:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928390:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928394:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928399:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928404:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928409:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928413:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928418:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928422:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928426:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928438:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928442:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928447:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928451:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928455:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928460:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928464:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928469:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928474:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928479:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928484:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928488:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928493:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928497:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928502:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928506:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928512:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928516:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928520:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928525:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928529:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928534:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928551:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928557:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.928561:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930106:0:18662:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98f7c384e400:18662] 0 exiting: rc = 1 00000100:00100000:0.0:1787384744.930509:0:18663:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98f8d9461a00:18663] 1 exiting: rc = 0 00000100:00100000:0.0:1787384744.930655:0:18664:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98f8d9460800:18664] 2 exiting: rc = 0 00000100:00100000:1.0:1787384744.930825:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930831:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930836:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930841:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930856:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930862:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930867:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930873:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930879:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930895:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930901:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930907:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930913:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930919:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930924:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930930:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930935:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930941:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930946:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930951:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930957:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930963:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930968:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930974:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930979:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930984:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930990:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.930995:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931013:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931018:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931023:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931028:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931033:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931038:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931042:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931047:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931052:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931057:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931062:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931067:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931072:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931077:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931082:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931087:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931100:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931105:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931110:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931115:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931120:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931125:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931130:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931134:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931153:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931160:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931165:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931170:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931175:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931180:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931185:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931190:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931203:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931210:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931214:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.931220:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384744.936835:0:18665:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98f8c6e73c00:18665] 0 exiting: rc = 1 00000100:00100000:0.0:1787384744.937076:0:18666:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98f8c6ef9000:18666] 1 exiting: rc = 0 00000100:00100000:1.0:1787384744.937312:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937319:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937324:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937329:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937334:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937339:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937344:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937349:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937354:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937358:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937363:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937368:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937374:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937379:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937390:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937406:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937411:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937419:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937425:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937430:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937434:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937439:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937444:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937449:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937453:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937459:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937463:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937468:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937474:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937478:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937484:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937489:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937494:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937499:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937504:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937509:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937514:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937519:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937524:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937529:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937534:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937547:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937553:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937558:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937563:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937567:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937572:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937577:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937582:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937586:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937598:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937602:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937607:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937611:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937615:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937620:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937625:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937630:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937635:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937644:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937651:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937655:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937661:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.937735:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384744.938633:0:18667:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98f8c74fca00:18667] 0 exiting: rc = 1 00000100:00100000:3.0:1787384744.938772:0:18668:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98f8c74fc000:18668] 1 exiting: rc = 0 00000100:00100000:1.0:1787384744.939091:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939098:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939111:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939135:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939141:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939148:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939154:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939160:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939167:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939172:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939179:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939184:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939190:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939197:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939202:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939222:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939229:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939235:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939240:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939246:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939251:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939266:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939273:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939279:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939287:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939292:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939298:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939319:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939327:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939332:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939337:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939342:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939347:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939353:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939359:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939365:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939370:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939375:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939381:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939398:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939405:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939410:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939418:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939424:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939430:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939435:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939441:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939448:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939455:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939461:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939468:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939489:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939499:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939505:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939511:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939516:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939528:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939534:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939550:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939564:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939578:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939585:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939593:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384744.939607:0:21327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787384744.946461:0:21327:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787384765.740216:0:22092:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787384777.400735:0:22691:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787384777.400741:0:22691:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787384777.400743:0:22691:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787384777.401130:0:22691:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98f8f0fb9000 00000020:01000004:2.0:1787384777.401145:0:22691:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787384777.401152:0:22691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787384777.401166:0:22691:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98f8f59399c0) 00000020:00000080:2.0:1787384777.401177:0:22691:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787384777.495893:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787384777.498090:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.498661:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787384777.498902:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.499196:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787384777.499470:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787384777.499769:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787384777.500100:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787384777.500519:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787384777.500755:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.501428:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787384777.501930:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.502842:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.503164:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.503507:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787384777.503746:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.504028:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.504273:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.504912:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787384777.505172:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787384777.505868:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.506400:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.506871:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787384777.507586:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.508075:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787384777.508421:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787384777.508682:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787384777.510610:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787384777.510973:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787384777.511633:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787384777.512159:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787384777.514667:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787384777.515227:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787384777.515559:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787384777.521000:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787384777.521877:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787384777.522212:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787384777.522740:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787384777.524927:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787384777.526396:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787384777.527099:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787384777.527591:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787384777.527841:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787384777.528387:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787384777.528640:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787384777.528917:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787384777.531848:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787384777.533766:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787384777.534448:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787384777.534662:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787384777.535197:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787384777.535508:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1787384777.535725:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1787384777.542937:0:22691:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787384777.543416:0:22691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787384777.543424:0:22691:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787384777.543437:0:22691:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba41b5 00000020:01000004:2.0:1787384777.543511:0:22691:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787384777.543516:0:22691:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787384777.543522:0:22691:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f8f0fb9000 from MGS 00000020:01000004:2.0:1787384777.543525:0:22691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787384777.543547:0:22691:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98f8f593cd40) 00000020:00000080:2.0:1787384777.543558:0:22691:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787384777.543615:0:22691:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f0fb9000 from MGS, refs=2 00080000:01000000:2.0:1787384777.543620:0:22691:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787384777.543625:0:22691:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba41c3 00000100:00100000:2.0:1787384777.543713:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787384777.544389:0:22691:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787384777.544395:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787384777.545293:0:22691:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787384777.545302:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787384777.546563:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384777.546725:0:22691:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787384777.546731:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787384777.550983:0:22691:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787384777.550995:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787384777.551915:0:22691:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787384777.551923:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787384777.552692:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384777.552696:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384777.552698:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384777.553461:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384777.553464:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384777.553466:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384777.555712:0:22691:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787384777.557028:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787384777.565185:0:22691:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787384777.569365:0:22704:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787384777.569492:0:22691:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787384777.569548:0:22691:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787384777.570271:0:22691:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787384777.570589:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384777.570737:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787384777.570744:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787384777.571563:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787384777.571571:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787384777.580192:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787384777.580215:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787384777.582866:0:22691:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787384777.582890:0:22691:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.145@tcp' 00000020:01000004:3.0:1787384777.582892:0:22691:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787384777.582926:0:22691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.145@tcp (typ=mgc) 00000020:00000080:3.0:1787384777.582938:0:22691:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.145@tcp (ffff98f7c2898000) 00000020:00000080:3.0:1787384777.582965:0:22691:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787384777.583047:0:22691:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8f4b9e000@MGC192.168.203.145@tcp: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384777.583189:0:22691:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.145@tcp-0 is initialized 00000040:01000000:3.0:1787384777.583196:0:22691:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787384777.583650:0:22708:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787384777.585581:0:22709:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787384777.585663:0:22691:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.145@tcp (uuid a654d8f2-2ab4-4025-870e-e3edf79de730) 00000020:00000080:3.0:1787384777.585685:0:22691:0:(genops.c:1406:class_connect()) connect: client a654d8f2-2ab4-4025-870e-e3edf79de730, cookie 0x7ef423838fba41d1 00000100:00080000:3.0:1787384777.585696:0:22691:0:(import.c:510:import_select_connection()) MGC192.168.203.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384777.585702:0:22691:0:(import.c:624:import_select_connection()) MGC192.168.203.145@tcp: import ffff98f8f4b9e000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384777.585733:0:22691:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f54fbb80 x1874208203443840/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384777.585769:0:22691:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a654d8f2-2ab4-4025-870e-e3edf79de730->MGS 00000020:01000004:3.0:1787384777.585807:0:22691:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:2.0:1787384777.585930:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a654d8f2-2ab4-4025-870e-e3edf79de730:3650:1874208203443840:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787384777.586007:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384777.586261:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203443840 00000100:00100000:3.0:1787384777.586269:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203443840 00000100:00100000:3.0:1787384777.586305:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384777.586313:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3650:x1874208203443840:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787384777.586346:0:22705:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a654d8f2-2ab4-4025-870e-e3edf79de730@0@lo t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:3.0:1787384777.586367:0:22705:0:(genops.c:1406:class_connect()) connect: client a654d8f2-2ab4-4025-870e-e3edf79de730, cookie 0x7ef423838fba41d8 00000100:00080000:3.0:1787384777.586633:0:22705:0:(import.c:65:import_set_state_nolock()) ffff98f8f4b9c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384777.586692:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+5:3650:x1874208203443840:12345-0@lo:250:mount.lustre.0 Request processed in 378us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384777.586700:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384777.586735:0:3650:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787384777.586752:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.145@tcp: connect to target with instance 0 00000100:00080000:3.0:1787384777.586760:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787384777.586763:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787384777.586803:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f4b9e000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787384777.586807:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787384777.586812:0:3650:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787384777.586935:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a654d8f2-2ab4-4025-870e-e3edf79de730:3650:1874208203443840:0@lo:250:mount.lustre.0 00000020:01000004:3.0:1787384777.586986:0:22691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787384777.586999:0:22691:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98f7c28999c0) 00000020:00000080:3.0:1787384777.587009:0:22691:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787384777.624687:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384777.624901:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787384777.624908:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787384777.629923:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787384777.629936:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787384777.630701:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787384777.630709:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787384777.634154:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384777.634338:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787384777.634344:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787384777.643292:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787384777.643312:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787384777.705277:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787384777.705466:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787384777.705472:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787384777.710477:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787384777.710497:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787384777.711212:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384777.711391:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787384777.711396:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787384777.712984:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787384777.712994:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787384777.713527:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384777.713681:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787384777.713687:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787384777.717533:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787384777.717546:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787384777.721359:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384777.722204:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787384777.722219:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787384777.723841:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787384777.723852:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787384777.757772:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384777.758170:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787384777.758176:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787384777.760078:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787384777.760093:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787384777.761219:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787384777.761229:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787384777.762251:0:22691:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787384777.762282:0:22691:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787384777.762290:0:22691:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787384777.762416:0:22691:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787384777.762451:0:22691:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.145@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787384777.762456:0:22691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787384777.762457:0:22691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384777.762459:0:22691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384777.762460:0:22691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384777.762461:0:22691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384777.762462:0:22691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384777.762463:0:22691:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384777.762465:0:22691:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384777.762467:0:22691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384777.762468:0:22691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384777.762471:0:22691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787384777.762473:0:22691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384777.762474:0:22691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384777.762475:0:22691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384777.762476:0:22691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384777.762477:0:22691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384777.762483:0:22691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384777.762484:0:22691:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384777.762485:0:22691:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384777.762486:0:22691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384777.762487:0:22691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384777.762525:0:22691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787384777.762545:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203443968:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787384777.762639:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384777.762691:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787384777.763078:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203443968 00000100:00100000:1.0:1787384777.763086:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203443968 00000100:00100000:1.0:1787384777.763133:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384777.763146:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+5:22691:x1874208203443968:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787384777.763195:0:22707:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787384777.763205:0:22707:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787384777.763208:0:22707:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787384777.763611:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787384777.764267:0:22707:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1787384777.766220:0:22730:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787384777.766227:0:22730:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787384777.766230:0:22730:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787384777.766233:0:22730:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787384777.766419:0:22730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787384777.767699:0:22707:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787384777.767711:0:22707:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787384777.770371:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+5:22691:x1874208203443968:12345-0@lo:253:mount.lustre.0 Request processed in 7217us (7722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384777.770386:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384777.770609:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203443968:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787384777.770625:0:22691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787384777.770628:0:22691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384777.770631:0:22691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384777.770632:0:22691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384777.770633:0:22691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384777.770635:0:22691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384777.770636:0:22691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384777.770638:0:22691:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384777.770639:0:22691:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384777.770641:0:22691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384777.770642:0:22691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787384777.770665:0:22691:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f8f0fb9000 from lustre-MDT0000 10000000:01000000:3.0:1787384777.770696:0:22691:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787384777.770699:0:22691:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787384777.770703:0:22691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98f7c2898000 10000000:01000000:3.0:1787384777.770707:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384777.770714:0:22691:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98f7c2898000 from 1 10000000:01000000:3.0:1787384777.770717:0:22691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787384777.770754:0:22691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384777.770918:0:22691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384777.770931:0:22691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384777.770953:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203444096:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384777.770992:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384777.771078:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787384777.771256:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203444096 00000100:00100000:2.0:1787384777.771263:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203444096 00000100:00100000:2.0:1787384777.771307:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384777.771326:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+5:22691:x1874208203444096:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384777.771338:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384777.771353:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090e00/0x7ef423838fba41ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba41e6 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384777.771375:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090e00/0x7ef423838fba41ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba41e6 expref: 6 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384777.771385:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090e00/0x7ef423838fba41ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba41e6 expref: 6 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384777.771394:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090e00, rc 0) 00000100:00100000:2.0:1787384777.771448:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+6:22691:x1874208203444096:12345-0@lo:101:mount.lustre.0 Request processed in 132us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384777.771455:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384777.771658:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203444096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384777.771673:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384777.771682:0:22691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384777.771743:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203444224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384777.771771:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384777.771892:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787384777.771955:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203444224 00000100:00100000:2.0:1787384777.771960:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203444224 00000100:00100000:2.0:1787384777.771994:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384777.772000:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+6:22691:x1874208203444224:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384777.772081:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+6:22691:x1874208203444224:12345-0@lo:501:mount.lustre.0 Request processed in 80us (308us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787384777.772088:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384777.772199:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203444224:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787384777.772231:0:22691:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787384777.772248:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384777.772258:0:22691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384777.772265:0:22691:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f8f0fb9000 10000000:01000000:1.0:1787384777.772271:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787384777.772275:0:22691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98f8f0fb9000 10000000:01000000:1.0:1787384777.772288:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787384777.772291:0:22691:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98f8f0fb9000 from 1 10000000:01000000:1.0:1787384777.772294:0:22691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787384777.772324:0:22691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba41f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384777.772331:0:22691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba41f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384777.772339:0:22691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba41f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384777.772354:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203444352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787384777.772378:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384777.772408:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787384777.772473:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203444352 00000100:00100000:0.0:1787384777.772478:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203444352 00000100:00100000:0.0:1787384777.772521:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384777.772527:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+6:22691:x1874208203444352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384777.772535:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384777.772547:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b04a00/0x7ef423838fba41fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba41f4 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384777.772562:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b04a00/0x7ef423838fba41fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba41f4 expref: 7 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384777.772570:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b04a00/0x7ef423838fba41fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba41f4 expref: 7 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384777.772577:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04a00, rc 0) 00000100:00100000:0.0:1787384777.772605:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+7:22691:x1874208203444352:12345-0@lo:101:mount.lustre.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384777.772612:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384777.772829:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203444352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384777.772841:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba41f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41fb expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384777.772849:0:22691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba41f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba41fb expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384777.772861:0:22691:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787384777.772865:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba41f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41fb expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384777.772872:0:22691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba41f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41fb expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384777.772878:0:22691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787384777.772887:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787384777.772892:0:22691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98f8f0fb9000 10000000:01000000:1.0:1787384777.772895:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787384777.772897:0:22691:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787384777.772900:0:22691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787384777.772915:0:22691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba4202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384777.772922:0:22691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba4202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384777.772929:0:22691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba4202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384777.772943:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203444480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787384777.772967:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384777.772977:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787384777.773118:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203444480 00000100:00100000:3.0:1787384777.773122:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203444480 00000100:00100000:3.0:1787384777.773145:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384777.773152:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+7:22691:x1874208203444480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384777.773159:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384777.773169:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902158200/0x7ef423838fba4209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba4202 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384777.773184:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902158200/0x7ef423838fba4209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba4202 expref: 8 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384777.773192:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902158200/0x7ef423838fba4209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4202 expref: 8 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384777.773198:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902158200, rc 0) 00000100:00100000:3.0:1787384777.773225:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+8:22691:x1874208203444480:12345-0@lo:101:mount.lustre.0 Request processed in 74us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384777.773231:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787384777.773405:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203444480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384777.773414:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba4202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba4209 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384777.773422:0:22691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba4202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba4209 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384777.773730:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203444608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384777.773761:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384777.774404:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203444608 00000100:00100000:3.0:1787384777.774413:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203444608 00000100:00100000:3.0:1787384777.774451:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384777.774462:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+8:22691:x1874208203444608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384777.776160:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+9:22691:x1874208203444608:12345-0@lo:501:mount.lustre.0 Request processed in 1690us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384777.776172:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384777.776456:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787384777.776484:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203444608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384777.776728:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203444736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384777.776886:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384777.777079:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787384777.780408:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203444736 00000100:00100000:2.0:1787384777.780574:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203444736 00000100:00100000:2.0:1787384777.780767:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384777.781280:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+9:22691:x1874208203444736:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384777.783299:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+9:22691:x1874208203444736:12345-0@lo:503:mount.lustre.0 Request processed in 2516us (6405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384777.783321:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787384777.783449:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203444736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384777.786330:0:22731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22731:1874208203444864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384777.786409:0:22731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384777.786460:0:22731:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787384777.786525:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203444864 00000100:00100000:3.0:1787384777.786532:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203444864 00000100:00100000:3.0:1787384777.786580:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384777.786590:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+9:22731:x1874208203444864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384777.787826:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+9:22731:x1874208203444864:12345-0@lo:502:llog_process_th.0 Request processed in 1233us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384777.787838:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787384777.788689:0:22731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22731:1874208203444864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787384777.788733:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384777.788747:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384777.788750:0:22731:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787384777.788755:0:22731:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787384777.788759:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384777.788773:0:22731:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98f7c211b380) 00000020:00000080:1.0:1787384777.789136:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787384777.789144:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787384777.789223:0:22731:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787384777.789230:0:22731:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba4217 00000020:00000080:1.0:1787384777.790677:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787384777.790689:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384777.790698:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384777.790700:0:22731:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787384777.790703:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384777.790708:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384777.790709:0:22731:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787384777.790713:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384777.790726:0:22731:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98f7c211cd40) 00000020:00000080:1.0:1787384777.790743:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787384777.790761:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787384777.790763:0:22731:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787384777.790766:0:22731:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787384777.790772:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787384777.790980:0:22731:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f0fb9000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787384777.791262:0:22731:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98f7c2118000) 00000020:00000080:1.0:1787384777.791273:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787384777.791351:0:22731:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787384777.791357:0:22731:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba422c 00000020:00000080:1.0:1787384777.791481:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787384777.791488:0:22731:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787384777.791492:0:22731:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7ef423838fba4233 00080000:01000000:1.0:1787384777.791498:0:22731:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787384777.791502:0:22731:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba423a 00010000:00010000:2.0:1787384777.905910:0:22731:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787384777.907000:0:22731:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:2.0:1787384777.907989:0:22731:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787384777.908637:0:22731:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98f8f5938000) 00000020:00000080:2.0:1787384777.908654:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787384777.908720:0:22731:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787384777.908727:0:22731:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba4248 00000020:00000080:3.0:1787384777.921885:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787384777.927468:0:22731:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7ef423838fba424f 00000020:00000080:0.0:1787384777.927858:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787384777.927869:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384777.927876:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384777.927879:0:22731:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787384777.927882:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787384777.927885:0:22731:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1787384777.927887:0:22731:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787384777.927888:0:22731:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787384777.927890:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787384777.927892:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384777.927894:0:22731:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787384777.927897:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384777.927901:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384777.927903:0:22731:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787384777.927907:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787384777.927968:0:22731:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787384777.927986:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384777.927989:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384777.927991:0:22731:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787384777.927994:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384777.927997:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384777.927998:0:22731:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787384777.928001:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787384777.928007:0:22731:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:00000080:0.0:1787384777.928033:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787384777.928046:0:22731:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98f8fc2b3380) 00000020:00000080:0.0:1787384777.928061:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787384777.928066:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787384777.928121:0:22731:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787384777.928126:0:22731:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787384777.928132:0:22731:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba425d 00010000:00080000:0.0:1787384777.928162:0:22731:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8f7df1000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.145@tcp at head 00010000:00010000:0.0:1787384777.932730:0:22731:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787384777.944089:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787384777.944105:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787384777.944141:0:22731:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787384777.944161:0:22731:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba4264 00000100:00080000:3.0:1787384777.944172:0:22731:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384777.944178:0:22731:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f7df1000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384777.944224:0:22731:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f54f8a80 x1874208203444992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384777.944265:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203444992:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787384777.944354:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787384777.944410:0:22731:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787384777.944575:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384777.944579:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384777.944581:0:22731:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787384777.944584:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787384777.944586:0:22731:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1787384777.944588:0:22731:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787384777.944589:0:22731:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787384777.944591:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787384777.944593:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384777.944594:0:22731:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787384777.944597:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787384777.944601:0:22731:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787384777.944604:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384777.944605:0:22731:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787384777.944608:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787384777.944611:0:22731:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:01000000:3.0:1787384777.944631:0:22731:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787384777.944634:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384777.944648:0:22731:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98f7c289b380) 00000020:00000080:3.0:1787384777.944661:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787384777.944666:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787384777.944722:0:22731:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787384777.944728:0:22731:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787384777.944733:0:22731:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba4272 00010000:00080000:3.0:1787384777.944765:0:22731:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f7c354a000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384777.944997:0:22731:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1787384777.945458:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203445120:0@lo:400:kworker.0 00000100:00100000:0.0:1787384777.945507:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384777.945590:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203445120 00000100:00100000:0.0:1787384777.945598:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203445120 00000100:00100000:0.0:1787384777.945637:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384777.945646:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+9:3653:x1874208203445120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384777.945693:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+9:3653:x1874208203445120:12345-0@lo:400:kworker.0 Request processed in 48us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384777.945700:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384777.945748:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203445120:0@lo:400:kworker.0 00000100:00100000:0.0:1787384777.945837:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203444992 00000100:00100000:0.0:1787384777.945849:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203444992 00000100:00100000:0.0:1787384777.945874:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384777.945879:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203444992:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1787384777.945893:0:22718:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1787384777.953593:0:22731:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787384777.957425:0:22731:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787384777.965336:0:22731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384777.965640:0:22731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1787384777.979127:0:22731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1787384777.987847:0:22737:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787384777.987861:0:22737:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787384777.988605:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787384777.988617:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787384777.988650:0:22731:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787384777.988669:0:22731:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba4279 00000100:00080000:3.0:1787384777.988677:0:22731:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384777.988682:0:22731:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f7c354a000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384777.988714:0:22731:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f54fa680 x1874208203445248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384777.988806:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203445248:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787384777.988860:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203445248 offset 0 length 520: 4 00000100:00080000:3.0:1787384777.988981:0:22731:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787384777.989027:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384777.989032:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384777.989034:0:22731:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787384777.989036:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787384777.989038:0:22731:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1787384777.989040:0:22731:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787384777.989041:0:22731:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787384777.989043:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787384777.989045:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384777.989046:0:22731:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787384777.989048:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787384777.989052:0:22731:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787384777.989055:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384777.989057:0:22731:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787384777.989059:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787384777.989064:0:22731:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:01000000:3.0:1787384777.989082:0:22731:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787384777.989084:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384777.989094:0:22731:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98f7c289cd40) 00000020:00000080:3.0:1787384777.989105:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1787384777.989109:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787384777.989170:0:22731:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787384777.989176:0:22731:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787384777.989182:0:22731:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba4287 00010000:00080000:3.0:1787384777.989218:0:22731:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8d9b5c800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384777.989415:0:22731:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787384777.989481:0:22731:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787384777.989495:0:22731:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787384777.997414:0:22731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787384777.997707:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203444992:12345-0@lo:38:llog_process_th.0 Request processed in 51821us (53347us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787384777.997720:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787384777.999458:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7df1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384777.999470:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787384777.999474:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203444992:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787384777.999630:0:22731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1787384777.999872:0:22731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1787384778.000753:0:22739:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787384778.000759:0:22739:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787384778.002419:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787384778.002890:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787384778.002943:0:22731:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787384778.002964:0:22731:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba428e 00000100:00080000:2.0:1787384778.002974:0:22731:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787384778.002980:0:22731:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f8d9b5c800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384778.003014:0:22731:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f0ff3100 x1874208203445376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384778.003074:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203445376:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787384778.003127:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203445376 offset 0 length 520: 4 00000100:00080000:2.0:1787384778.003180:0:22731:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787384778.003253:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384778.003258:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384778.003259:0:22731:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787384778.003262:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384778.003274:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384778.003275:0:22731:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787384778.003278:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787384778.003280:0:22731:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787384778.003282:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384778.003284:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384778.003286:0:22731:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787384778.003288:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384778.003290:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384778.003291:0:22731:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787384778.003294:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787384778.003333:0:22731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22731:1874208203445504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384778.003380:0:22731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384778.003410:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203445504 00000100:00100000:2.0:1787384778.003416:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203445504 00000100:00100000:2.0:1787384778.003465:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384778.003475:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+9:22731:x1874208203445504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384778.003587:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+9:22731:x1874208203445504:12345-0@lo:502:llog_process_th.0 Request processed in 113us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384778.003594:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384778.003636:0:22731:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d956c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384778.003657:0:22731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22731:1874208203445504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384778.003679:0:22731:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384778.003683:0:22731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384778.003684:0:22731:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787384778.003687:0:22731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787384778.003737:0:22691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787384778.003759:0:22691:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787384778.003775:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba4202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba4209 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384778.005909:0:22691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba4202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba4209 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384778.005919:0:22691:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f0fb9000 from 1 10000000:01000000:2.0:1787384778.005922:0:22691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787384778.005960:0:22691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384778.005968:0:22691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384778.005977:0:22691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384778.006000:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203445632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787384778.006060:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384778.006084:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8cadf8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384778.007558:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203445632 00000100:00100000:0.0:1787384778.007568:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203445632 00000100:00100000:0.0:1787384778.007623:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384778.007632:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+9:22691:x1874208203445632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384778.007645:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384778.007662:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b04200/0x7ef423838fba429c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba4295 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.007684:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b04200/0x7ef423838fba429c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba4295 expref: 10 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.007693:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b04200/0x7ef423838fba429c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4295 expref: 10 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.007702:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04200, rc 0) 00000100:00100000:0.0:1787384778.007766:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+10:22691:x1874208203445632:12345-0@lo:101:mount.lustre.0 Request processed in 135us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384778.007773:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787384778.007988:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203445632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384778.008005:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba429c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.008013:0:22691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba429c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384778.008703:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203445760:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787384778.008762:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384778.008823:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384778.010574:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203445760 00000100:00100000:0.0:1787384778.010602:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203445760 00000100:00100000:0.0:1787384778.010655:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787384778.010664:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+10:22691:x1874208203445760:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787384778.010686:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787384778.010693:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787384778.010843:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+10:22691:x1874208203445760:12345-0@lo:256:mount.lustre.0 Request processed in 179us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384778.010852:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787384778.012760:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203445760:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787384778.013601:0:22691:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787384778.013667:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba429c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.013680:0:22691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba429c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384778.013688:0:22691:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f0fb9000 from 1 10000000:01000000:3.0:1787384778.013691:0:22691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384778.013730:0:22691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.013809:0:22691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.013820:0:22691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384778.013841:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203445888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384778.013899:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384778.013932:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384778.014605:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203445888 00000100:00100000:0.0:1787384778.014613:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203445888 00000100:00100000:0.0:1787384778.014666:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384778.014677:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+10:22691:x1874208203445888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384778.014690:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384778.014708:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba42aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba42a3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.014734:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba42aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba42a3 expref: 11 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.014745:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba42aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba42a3 expref: 11 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.014754:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05c00, rc 0) 00000100:00100000:0.0:1787384778.014847:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+11:22691:x1874208203445888:12345-0@lo:101:mount.lustre.0 Request processed in 172us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384778.014854:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787384778.015121:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203445888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384778.015138:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba42aa expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.015147:0:22691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba42aa expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384778.015227:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203446016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384778.015257:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384778.015288:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384778.015403:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203446016 00000100:00100000:0.0:1787384778.015407:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203446016 00000100:00100000:0.0:1787384778.015449:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787384778.015467:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+11:22691:x1874208203446016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384778.015590:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+11:22691:x1874208203446016:12345-0@lo:501:mount.lustre.0 Request processed in 123us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384778.015597:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384778.015759:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203446016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384778.015987:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203446144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384778.016028:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384778.016041:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384778.016660:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203446144 00000100:00100000:0.0:1787384778.016666:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203446144 00000100:00100000:0.0:1787384778.016714:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787384778.016722:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+11:22691:x1874208203446144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384778.017001:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+11:22691:x1874208203446144:12345-0@lo:503:mount.lustre.0 Request processed in 278us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384778.017009:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384778.017116:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203446144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384778.017994:0:22741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22741:1874208203446272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384778.018049:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384778.018123:0:22741:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384778.018158:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203446272 00000100:00100000:0.0:1787384778.018163:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203446272 00000100:00100000:0.0:1787384778.018287:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787384778.018296:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+11:22741:x1874208203446272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384778.018819:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+11:22741:x1874208203446272:12345-0@lo:502:llog_process_th.0 Request processed in 522us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384778.018828:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787384778.019044:0:22741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22741:1874208203446272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384778.019072:0:22741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384778.019082:0:22741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384778.019084:0:22741:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787384778.019090:0:22741:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f0fb9000 00000020:00000080:2.0:1787384778.019093:0:22741:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787384778.019100:0:22741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384778.019102:0:22741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384778.019103:0:22741:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787384778.019106:0:22741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384778.019108:0:22741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384778.019115:0:22741:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787384778.019119:0:22741:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f0fb9000 00000020:00000080:2.0:1787384778.019121:0:22741:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787384778.019181:0:22741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384778.019185:0:22741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384778.019186:0:22741:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787384778.019188:0:22741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384778.019190:0:22741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384778.019192:0:22741:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787384778.019195:0:22741:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f0fb9000 00000020:00000080:2.0:1787384778.019207:0:22741:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787384778.019227:0:22741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384778.019230:0:22741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384778.019232:0:22741:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787384778.019234:0:22741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384778.019236:0:22741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384778.019237:0:22741:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787384778.019241:0:22741:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f0fb9000 00000020:00000080:2.0:1787384778.019243:0:22741:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787384778.019279:0:22741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22741:1874208203446400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384778.019329:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384778.023381:0:22741:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8cadf8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384778.030564:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203446400 00000100:00100000:1.0:1787384778.030579:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203446400 00000100:00100000:1.0:1787384778.030637:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384778.030648:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+11:22741:x1874208203446400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384778.030840:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+11:22741:x1874208203446400:12345-0@lo:502:llog_process_th.0 Request processed in 193us (11509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384778.030849:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787384778.033597:0:22741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22741:1874208203446400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787384778.033644:0:22741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384778.033661:0:22741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384778.033663:0:22741:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787384778.033669:0:22741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787384778.033837:0:22691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787384778.033862:0:22691:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384778.033884:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba42aa expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.033894:0:22691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba42aa expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384778.033948:0:22691:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787384778.033951:0:22691:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f8f0fb9000 10000000:01000000:3.0:1787384778.033953:0:22691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f8f0fb9000 10000000:01000000:3.0:1787384778.033957:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384778.033963:0:22691:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f0fb9000 from 1 10000000:01000000:3.0:1787384778.033965:0:22691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787384778.033997:0:22691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba42b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.034005:0:22691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba42b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.034013:0:22691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba42b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384778.034031:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203446528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384778.034088:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384778.034125:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c11caf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384778.034903:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203446528 00000100:00100000:1.0:1787384778.034911:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203446528 00000100:00100000:1.0:1787384778.034949:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384778.034958:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+11:22691:x1874208203446528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384778.034970:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384778.034985:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965a000/0x7ef423838fba42b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba42b1 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.035007:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965a000/0x7ef423838fba42b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba42b1 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.035017:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965a000/0x7ef423838fba42b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba42b1 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.035026:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a000, rc 0) 00000100:00100000:1.0:1787384778.035073:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22691:x1874208203446528:12345-0@lo:101:mount.lustre.0 Request processed in 115us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384778.035080:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787384778.035347:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203446528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384778.035370:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba42b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba42b8 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.035378:0:22691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba42b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba42b8 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384778.037305:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203446656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384778.037392:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384778.038354:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203446656 00000100:00100000:1.0:1787384778.038364:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203446656 00000100:00100000:1.0:1787384778.038409:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384778.038418:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22691:x1874208203446656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384778.038535:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c11caf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384778.039534:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22691:x1874208203446656:12345-0@lo:501:mount.lustre.0 Request processed in 1113us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384778.039551:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787384778.040697:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203446656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384778.040756:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203446784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384778.042593:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384778.042633:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c11caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384778.042912:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203446784 00000100:00100000:0.0:1787384778.042919:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203446784 00000100:00100000:0.0:1787384778.042971:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787384778.042981:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22691:x1874208203446784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384778.043103:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22691:x1874208203446784:12345-0@lo:503:mount.lustre.0 Request processed in 123us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384778.043111:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787384778.043331:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203446784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384778.045182:0:22745:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22745:1874208203446912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384778.045341:0:22745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384778.045379:0:22745:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9b413c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384778.046393:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203446912 00000100:00100000:1.0:1787384778.046402:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203446912 00000100:00100000:1.0:1787384778.046525:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384778.046535:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22745:x1874208203446912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384778.046684:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22745:x1874208203446912:12345-0@lo:502:llog_process_th.0 Request processed in 150us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384778.046692:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787384778.047513:0:22745:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22745:1874208203446912:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787384778.047582:0:22745:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787384778.047597:0:22745:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98f8f7d319c0) 00000020:00000080:3.0:1787384778.047616:0:22745:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1787384778.052363:0:22745:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f0fb9000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787384778.052374:0:22745:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f0fb9000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787384778.052377:0:22745:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f0fb9000 4 00010000:00080000:3.0:1787384778.052414:0:22745:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8d969c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384778.054019:0:22745:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1787384778.054119:0:22745:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787384778.054165:0:22745:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787384778.054178:0:22745:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7ef423838fba42c6 00000100:00080000:3.0:1787384778.054196:0:22745:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384778.054201:0:22745:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98f8d969c800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384778.054236:0:22745:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f54f8380 x1874208203447040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384778.054270:0:22745:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787384778.054703:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203447040:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787384778.054773:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384778.058965:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203447040 00000100:00100000:3.0:1787384778.058982:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203447040 00000100:00100000:3.0:1787384778.059035:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384778.059043:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874208203447040:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787384778.059136:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874208203447040:12345-0@lo:38:llog_process_th.0 Request processed in 92us (4362us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787384778.059142:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384778.062983:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787384778.062998:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d969c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384778.063005:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787384778.063009:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203447040:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787384778.064679:0:22745:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22745:1874208203447168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384778.064754:0:22745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384778.064826:0:22745:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c11caf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384778.065911:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203447168 00000100:00100000:2.0:1787384778.065920:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203447168 00000100:00100000:2.0:1787384778.065971:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787384778.065981:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22745:x1874208203447168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384778.066127:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22745:x1874208203447168:12345-0@lo:502:llog_process_th.0 Request processed in 147us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384778.066142:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787384778.066267:0:22745:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22745:1874208203447168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384778.066334:0:22745:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22745:1874208203447296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384778.066371:0:22745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384778.066394:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203447296 00000100:00100000:2.0:1787384778.066398:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203447296 00000100:00100000:2.0:1787384778.066419:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787384778.066426:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22745:x1874208203447296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384778.066559:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22745:x1874208203447296:12345-0@lo:502:llog_process_th.0 Request processed in 132us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384778.066566:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787384778.066603:0:22745:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eb180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384778.066616:0:22745:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a654d8f2-2ab4-4025-870e-e3edf79de730:22745:1874208203447296:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787384778.066634:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787384778.070179:0:22691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787384778.070220:0:22691:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787384778.070245:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba42b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba42b8 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.070257:0:22691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba42b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba42b8 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787384778.070324:0:22691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787384778.070326:0:22691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384778.070328:0:22691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384778.070329:0:22691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384778.070330:0:22691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384778.070332:0:22691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384778.070338:0:22691:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384778.070339:0:22691:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384778.070341:0:22691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384778.070342:0:22691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787384778.070346:0:22691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787384778.070349:0:22691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384778.070350:0:22691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384778.070350:0:22691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384778.070351:0:22691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384778.070352:0:22691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384778.070353:0:22691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384778.070354:0:22691:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384778.070355:0:22691:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384778.070356:0:22691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384778.070356:0:22691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787384778.070382:0:22691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787384778.070403:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203447424:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787384778.070969:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384778.071009:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384778.072281:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203447424 00000100:00100000:2.0:1787384778.072292:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203447424 00000100:00100000:2.0:1787384778.072385:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384778.072395:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22691:x1874208203447424:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787384778.072426:0:22707:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787384778.072449:0:22707:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787384778.086582:0:22707:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787384778.086614:0:22707:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787384778.087052:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22691:x1874208203447424:12345-0@lo:253:mount.lustre.0 Request processed in 14655us (16079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384778.087065:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:1.0:1787384778.087150:0:22729:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787384778.087155:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787384778.087174:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.087188:0:22729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c3b04200/0x7ef423838fba429c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4295 expref: 11 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.087196:0:22729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.087230:0:22729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c3b04200/0x7ef423838fba429c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba4295 expref: 11 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.087253:0:22729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c3b04200/0x7ef423838fba429c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba4295 expref: 11 pid: 22705 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384778.087267:0:22729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203447552:0@lo:104: 00000100:00100000:1.0:1787384778.087302:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384778.087348:0:22729:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787384778.087453:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:22691:1874208203447424:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787384778.087466:0:22691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787384778.087468:0:22691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787384778.087470:0:22691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787384778.087471:0:22691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384778.087479:0:22691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787384778.087480:0:22691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384778.087481:0:22691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384778.087483:0:22691:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787384778.087484:0:22691:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787384778.087486:0:22691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384778.087488:0:22691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787384778.087504:0:22691:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787384778.090072:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203447552 00000100:00100000:0.0:1787384778.090089:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203447552 00000100:00100000:0.0:1787384778.090145:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384778.090156:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+3:22729:x1874208203447552:12345-0@lo:104: 00010000:00010000:0.0:1787384778.090173:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba429c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.090258:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384778.090264:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+3:22729:x1874208203447552:12345-0@lo:104: Request processed in 111us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384778.090272:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384778.090328:0:22729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203447552:0@lo:104: 00010000:00010000:0.0:1787384778.090352:0:22729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.090427:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384778.090434:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba429c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.090441:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384778.090446:0:22701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba429c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.090455:0:22701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba429c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384778.090462:0:22701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba429c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384778.090467:0:22701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787384778.090511:0:22701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba429c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.090518:0:22701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384778.090537:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba429c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.090544:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c2090400/0x7ef423838fba4295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba429c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384778.090574:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384778.090576:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384778.090578:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384778.090592:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a654d8f2-2ab4-4025-870e-e3edf79de730:3654:1874208203447680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384778.090632:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384778.090748:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203447680 00000100:00100000:0.0:1787384778.090753:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203447680 00010000:00010000:0.0:1787384778.090769:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c3b04200/0x7ef423838fba429c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba4295 expref: 12 pid: 22705 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384778.090828:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384778.090836:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+12:3654:x1874208203447680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384778.090846:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384778.090852:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c3b04200/0x7ef423838fba429c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba4295 expref: 12 pid: 22705 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.090874:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c3b04200/0x7ef423838fba429c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba4295 expref: 12 pid: 22705 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.090889:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3b04200/0x7ef423838fba429c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba4295 expref: 12 pid: 22705 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.090902:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.090910:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787384778.090925:0:22697:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003769450s 00010000:00010000:0.0:1787384778.090929:0:22697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.090936:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.090942:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.090948:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.090953:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ae00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384778.090957:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.090965:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.090986:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.090996:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384778.091029:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+11:3654:x1874208203447680:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384778.091036:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787384778.091055:0:22729:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.091062:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.091068:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba42cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384778.091096:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a654d8f2-2ab4-4025-870e-e3edf79de730:3654:1874208203447680:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787384778.104278:0:22691:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:2.0:1787384778.104698:0:22691:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787384778.105048:0:22753:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:1.0:1787384778.105053:0:22753:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:0.0:1787384778.105444:0:22754:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1787384778.105773:0:22754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787384778.108081:0:22691:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1787384778.108500:0:22754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787384778.108562:0:22754:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1787384778.114345:0:22691:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787384778.114387:0:22691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787384778.115525:0:22691:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787384778.115539:0:22691:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787384778.115594:0:22691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1787384778.116564:0:22755:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff98f8ee117b80 x1874208203447808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384778.116578:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00000040:00080000:2.0:1787384778.117249:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787384778.119101:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787384778.119301:0:22691:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787384778.121515:0:22691:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1787384778.122542:0:22691:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1787384778.124716:0:22691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1787384778.126606:0:22691:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787384778.126640:0:22691:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac6941987988 00100000:10000000:2.0:1787384778.126648:0:22691:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787384778.128152:0:22691:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787384778.128168:0:22691:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.145@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787384778.128187:0:22691:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787384778.128202:0:22691:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787384778.129112:0:22691:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384778.129298:0:22691:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787384778.625623:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787384778.870930:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787384778.870938:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f0fb9000 from 11 10000000:01000000:0.0:1787384778.870944:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787384778.870996:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.871007:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.871033:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384778.871059:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203447936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384778.871127:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384778.871173:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1787384778.871262:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203447936 00000100:00100000:3.0:1787384778.871270:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203447936 00000100:00100000:3.0:1787384778.871334:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787384778.871342:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+11:22709:x1874208203447936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384778.871356:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384778.871368:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902158400/0x7ef423838fba42db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba42d4 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.871390:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902158400/0x7ef423838fba42db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba42d4 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.871399:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902158400/0x7ef423838fba42db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba42d4 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384778.871419:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902158400, rc 0) 00000100:00100000:3.0:1787384778.871473:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22709:x1874208203447936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384778.871481:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787384778.871667:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203447936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384778.871681:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba42db expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.871690:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba42db expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384778.871741:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203448064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787384778.871813:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384778.871839:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eb180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384778.871926:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203448064 00000100:00100000:2.0:1787384778.871931:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203448064 00000100:00100000:2.0:1787384778.871964:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787384778.871972:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22709:x1874208203448064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787384778.871985:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787384778.872007:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787384778.872010:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787384778.872092:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+12:22709:x1874208203448064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384778.872099:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787384778.872264:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203448064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787384778.872329:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787384778.872335:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba42db expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384778.872343:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba42db expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384779.126986:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00000040:00080000:0.0:1787384779.135380:0:22748:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787384779.135390:0:22748:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384779.139711:0:22748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787384779.139724:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787384779.639042:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384780.150934:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00000040:00080000:0.0:1787384780.152192:0:22748:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787384780.152199:0:22748:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384780.152340:0:22748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1787384780.152386:0:22748:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384780.152544:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1787384780.663487:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384781.182629:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00010000:00010000:2.0:1787384781.686984:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384782.198865:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00010000:00010000:0.0:1787384782.718890:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384783.223869:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00000100:00080000:0.0:1787384783.289599:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787384783.289607:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787384783.289610:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8f7df1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384783.289618:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 673 00000100:00080000:0.0:1787384783.289623:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787384783.289630:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f7df1000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384783.289652:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f4a46300 x1874208203448320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384783.289669:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384783.289673:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384783.289676:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384783.289679:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384783.289681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787384783.289683:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787384783.289685:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8d969c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384783.289695:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98f8d969c800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384783.289707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f4a45c00 x1874208203448448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384783.289754:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203448192:0@lo:400:kworker.0 00000100:00100000:0.0:1787384783.289829:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384783.291482:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203448320:0@lo:38:kworker.0 00000100:00100000:0.0:1787384783.291594:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384783.291630:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203448448:0@lo:38:kworker.0 00000100:00100000:0.0:1787384783.291673:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384783.292534:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203448448 00000100:00100000:3.0:1787384783.292545:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203448448 00000100:00100000:3.0:1787384783.292630:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384783.292639:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874208203448448:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787384783.292669:0:22714:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1787384783.292704:0:22714:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7ef423838fba42e2 00000004:00100000:3.0:1787384783.292719:0:22714:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787384783.292863:0:22714:0:(import.c:65:import_set_state_nolock()) ffff98f8d969d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384783.292926:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874208203448448:12345-0@lo:38:kworker.0 Request processed in 286us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384783.292933:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787384783.293406:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f8f4a45c00 x1874208203448448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787384783.293424:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787384783.293433:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787384783.293439:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787384783.293441:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d969c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787384783.293447:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203448448:0@lo:38:kworker.0 00000100:00100000:2.0:1787384783.294650:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203448192 00000100:00100000:2.0:1787384783.294658:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203448192 00000100:00100000:2.0:1787384783.294902:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787384783.294915:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+12:3651:x1874208203448192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384783.295008:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+12:3651:x1874208203448192:12345-0@lo:400:kworker.0 Request processed in 97us (5179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384783.295015:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384783.295103:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203448192:0@lo:400:kworker.0 00000100:00100000:1.0:1787384783.295707:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203448320 00000100:00100000:1.0:1787384783.295714:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203448320 00000100:00100000:1.0:1787384783.296429:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384783.296438:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203448320:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787384783.296813:0:22719:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787384783.296945:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203448320:12345-0@lo:38:kworker.0 Request processed in 506us (5349us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787384783.296953:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787384783.297521:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7df1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787384783.297527:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787384783.297531:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203448320:0@lo:38:kworker.0 00000001:02000400:3.0:1787384783.347702:0:22997:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787384783.737486:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384784.249879:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00000020:00000004:3.0:1787384784.251138:0:23049:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384784.251427:0:23049:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787384784.761602:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787384785.023411:0:23100:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384785.023568:0:23100:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787384785.271285:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00010000:00010000:1.0:1787384785.783690:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384786.301046:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00010000:00010000:1.0:1787384786.809759:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384787.320899:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00000100:00100000:3.0:1787384787.386105:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384777/real 1787384777] req@ffff98f8f54fa680 x1874208203445248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384787 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384787.386136:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f54fa680 x1874208203445248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384787 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787384787.386165:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c354a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787384787.386183:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787384787.386187:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203445248:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787384787.393881:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787384787.393887:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787384787.393891:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f7df1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787384787.393893:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203448576:0@lo:400:kworker.0 00000100:00080000:2.0:1787384787.393897:0:16239:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:2.0:1787384787.393902:0:16239:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787384787.393909:0:16239:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f7df1000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384787.393930:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f0ff2d80 x1874208203448704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384787.393946:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384787.393949:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787384787.393950:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f7c354a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384787.393960:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 673 00000100:00100000:3.0:1787384787.393965:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787384787.393974:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787384787.393977:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f7c354a000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384787.393990:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f0ff1880 x1874208203448832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384787.393999:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384787.394002:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787384787.394023:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203448704:0@lo:38:kworker.0 00000100:00100000:2.0:1787384787.394032:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203448960:0@lo:400:kworker.0 00000100:00100000:3.0:1787384787.394051:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384787.394071:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203448832:0@lo:8:kworker.0 00000100:00100000:2.0:1787384787.394077:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:3.0:1787384787.394091:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203448832 offset 0 length 520: 4 00000100:00100000:3.0:1787384787.394112:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203448576 00000100:00100000:3.0:1787384787.394118:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203448576 00000100:00100000:3.0:1787384787.394170:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384787.394178:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+12:3652:x1874208203448576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384787.394225:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+12:3652:x1874208203448576:12345-0@lo:400:kworker.0 Request processed in 47us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384787.394233:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384787.394276:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203448704 00000100:00100000:3.0:1787384787.394280:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203448704 00000100:00100000:3.0:1787384787.394299:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384787.394304:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203448704:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787384787.394319:0:22718:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787384787.394362:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203448704:12345-0@lo:38:kworker.0 Request processed in 56us (309us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787384787.394368:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787384787.394409:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7df1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787384787.394413:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787384787.394417:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203448704:0@lo:38:kworker.0 00000100:00100000:3.0:1787384787.394441:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203448576:0@lo:400:kworker.0 00000100:00100000:1.0:1787384787.395467:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203448960 00000100:00100000:1.0:1787384787.395474:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203448960 00000100:00100000:1.0:1787384787.395520:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384787.395529:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203448960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384787.395588:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203448960:12345-0@lo:400:kworker.0 Request processed in 60us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384787.395595:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787384787.395677:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f8f0ff0380 x1874208203448960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384787.395689:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203448960:0@lo:400:kworker.0 00010000:00010000:3.0:1787384787.833441:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384788.344306:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00000100:00100000:0.0:1787384788.414656:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384778/real 1787384778] req@ffff98f8f0ff3100 x1874208203445376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384788 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384788.414685:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f0ff3100 x1874208203445376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384788 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787384788.414714:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d9b5c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787384788.414728:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787384788.414733:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203445376:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787384788.414840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787384788.414844:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787384788.414847:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8f7df1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384788.414853:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 682 00000100:00080000:0.0:1787384788.414858:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787384788.414864:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f7df1000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384788.414885:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f4a45c00 x1874208203449216/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384788.414899:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384788.414902:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384788.414904:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384788.414907:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787384788.414908:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8d9b5c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384788.414912:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 673 00000100:00080000:0.0:1787384788.414914:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787384788.414917:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f8d9b5c800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384788.414928:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f4a47100 x1874208203449344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384788.415164:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a654d8f2-2ab4-4025-870e-e3edf79de730:3654:1874208203449088:0@lo:400:kworker.0 00000100:00100000:0.0:1787384788.415520:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384788.415579:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203449216:0@lo:38:kworker.0 00000100:00100000:0.0:1787384788.415610:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384788.415630:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203449344:0@lo:8:kworker.0 00000400:00000100:0.0:1787384788.415652:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203449344 offset 0 length 520: 4 00000100:00100000:0.0:1787384788.415678:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203449088 00000100:00100000:0.0:1787384788.415685:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203449088 00000100:00100000:0.0:1787384788.415739:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787384788.415750:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+12:3654:x1874208203449088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384788.415837:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+12:3654:x1874208203449088:12345-0@lo:400:kworker.0 Request processed in 89us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384788.415845:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787384788.415883:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203449216 00000100:00100000:0.0:1787384788.415887:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203449216 00000100:00100000:0.0:1787384788.415912:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384788.415917:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203449216:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787384788.415933:0:22718:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787384788.415971:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203449216:12345-0@lo:38:kworker.0 Request processed in 52us (361us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787384788.415978:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384788.416011:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a654d8f2-2ab4-4025-870e-e3edf79de730:3654:1874208203449088:0@lo:400:kworker.0 00000100:00080000:0.0:1787384788.416039:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7df1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787384788.416043:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787384788.416047:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203449216:0@lo:38:kworker.0 00000100:00100000:3.0:1787384788.416645:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384788.416662:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203449472:0@lo:400:kworker.0 00000100:00100000:3.0:1787384788.416702:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384788.417023:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203449472 00000100:00100000:0.0:1787384788.417036:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203449472 00000100:00100000:0.0:1787384788.417071:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384788.417079:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203449472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384788.417121:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203449472:12345-0@lo:400:kworker.0 Request processed in 42us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384788.417127:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787384788.417161:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f8f4a46a00 x1874208203449472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384788.417172:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203449472:0@lo:400:kworker.0 00010000:00010000:1.0:1787384788.854977:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384789.366993:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00010000:00010000:3.0:1787384789.880107:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384790.391323:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00000040:00080000:0.0:1787384790.391724:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787384790.902885:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384791.414992:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00000020:01000004:1.0:1787384791.890067:0:23444:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787384791.890071:0:23444:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787384791.890072:0:23444:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787384791.890188:0:23444:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98f8efb5a800 00000020:01000004:1.0:1787384791.890200:0:23444:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1787384791.890211:0:23444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787384791.890233:0:23444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff98f7c21199c0) 00000020:00000080:1.0:1787384791.890246:0:23444:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1787384791.926939:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787384792.021568:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1787384792.022017:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787384792.024208:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787384792.024822:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787384792.025369:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787384792.025734:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787384792.026128:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787384792.027478:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787384792.027921:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1787384792.028436:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787384792.028962:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787384792.029549:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787384792.029761:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787384792.030034:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787384792.038648:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.044226:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.048864:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.049829:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.050098:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.050307:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.050591:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.050760:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.051419:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.051833:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.052089:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.053022:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.053609:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.054277:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.054647:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.055212:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.056089:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.056625:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.057669:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.060707:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.062700:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.063468:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.063813:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.064197:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.064508:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.066183:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.066878:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.067180:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.067650:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787384792.067934:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.068843:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787384792.069456:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00080000:01000000:2.0:1787384792.073982:0:23444:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787384792.074188:0:23444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787384792.074198:0:23444:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787384792.074210:0:23444:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba42f0 00000020:01000004:2.0:1787384792.074226:0:23444:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787384792.074248:0:23444:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787384792.074251:0:23444:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787384792.074257:0:23444:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787384792.074292:0:23444:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787384792.074296:0:23444:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.145@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787384792.084406:0:23444:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787384792.084586:0:23444:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.145@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1787384792.084591:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787384792.084593:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787384792.084594:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384792.084595:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384792.084597:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384792.084598:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384792.084599:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384792.084601:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384792.084602:0:23444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384792.084606:0:23444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1787384792.084608:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384792.084609:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787384792.084610:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384792.084611:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384792.084612:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384792.084613:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384792.084614:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384792.084620:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384792.084621:0:23444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384792.084646:0:23444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787384792.084666:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203449600:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787384792.084741:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384792.084875:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9672c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384792.085230:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203449600 00000100:00100000:2.0:1787384792.085238:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203449600 00000100:00100000:0.0:1787384792.086445:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787384792.086460:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+12:23444:x1874208203449600:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787384792.086494:0:22705:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787384792.086498:0:22705:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1787384792.086610:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787384792.087172:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+12:23444:x1874208203449600:12345-0@lo:253:mount.lustre.0 Request processed in 715us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384792.087181:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787384792.087371:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203449600:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787384792.087385:0:23444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787384792.087388:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384792.087390:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787384792.087391:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384792.087392:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384792.087393:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384792.087394:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384792.087396:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384792.087398:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384792.087399:0:23444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787384792.087421:0:23444:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f8efb5a800 from lustre-MDT0001 10000000:01000000:3.0:1787384792.087452:0:23444:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787384792.087456:0:23444:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787384792.087462:0:23444:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f7c2898000 local copy 00010000:00010000:3.0:1787384792.087474:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384792.087579:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203449728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384792.087612:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384792.087648:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d96723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384792.087762:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203449728 00000100:00100000:0.0:1787384792.087768:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203449728 00000100:00100000:0.0:1787384792.087829:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787384792.087838:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+12:23444:x1874208203449728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384792.087916:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+12:23444:x1874208203449728:12345-0@lo:501:mount.lustre.0 Request processed in 79us (303us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384792.087923:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787384792.088138:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203449728:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787384792.088151:0:23444:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787384792.088169:0:23444:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787384792.088175:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.088190:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384792.088227:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f8efb5a800 10000000:01000000:3.0:1787384792.088232:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787384792.088236:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98f7c2898000 10000000:01000000:3.0:1787384792.088238:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787384792.088241:0:23444:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98f7c2898000 from 1 10000000:01000000:3.0:1787384792.088244:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787384792.088266:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158e00/0x7ef423838fba42f7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.088275:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158e00/0x7ef423838fba42f7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.088284:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158e00/0x7ef423838fba42f7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384792.088299:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203449856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384792.088325:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384792.088352:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d96723c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384792.088401:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203449856 00000100:00100000:1.0:1787384792.088406:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203449856 00000100:00100000:1.0:1787384792.088437:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787384792.088444:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+12:23444:x1874208203449856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384792.088453:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384792.088465:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965be00/0x7ef423838fba42fe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba42f7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384792.088486:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965be00/0x7ef423838fba42fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba42f7 expref: 13 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384792.088497:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965be00/0x7ef423838fba42fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba42f7 expref: 13 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384792.088505:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965be00, rc 0) 00000100:00100000:1.0:1787384792.088551:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+13:23444:x1874208203449856:12345-0@lo:101:mount.lustre.0 Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384792.088558:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787384792.088719:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203449856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384792.088730:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158e00/0x7ef423838fba42f7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba42fe expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.088738:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158e00/0x7ef423838fba42f7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba42fe expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384792.088762:0:23444:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787384792.088775:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158e00/0x7ef423838fba42f7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba42fe expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.088996:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158e00/0x7ef423838fba42f7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba42fe expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384792.089004:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98f8efb5a800 10000000:01000000:3.0:1787384792.089009:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787384792.089012:0:23444:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98f8efb5a800 from 1 10000000:01000000:3.0:1787384792.089014:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787384792.089030:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba4305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.089042:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba4305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.089053:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba4305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384792.089066:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203449984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384792.089097:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384792.089124:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d96723c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384792.089165:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203449984 00000100:00100000:2.0:1787384792.089173:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203449984 00000100:00100000:2.0:1787384792.089208:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787384792.089225:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+13:23444:x1874208203449984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384792.089232:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384792.089244:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba430c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba4305 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.089259:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba430c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba4305 expref: 14 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.089271:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba430c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4305 expref: 14 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.089281:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091e00, rc 0) 00000100:00100000:2.0:1787384792.089321:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+14:23444:x1874208203449984:12345-0@lo:101:mount.lustre.0 Request processed in 107us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.089327:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787384792.089390:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203449984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384792.089403:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba4305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba430c expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384792.089411:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba4305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba430c expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384792.089427:0:23444:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787384792.089432:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba4305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba430c expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384792.089439:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba4305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba430c expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384792.089444:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787384792.089448:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787384792.089452:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98f8efb5a800 10000000:01000000:0.0:1787384792.089455:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787384792.089458:0:23444:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787384792.089460:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787384792.089473:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba4313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384792.089479:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba4313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384792.089485:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba4313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384792.089497:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203450112:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787384792.089543:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384792.089565:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a18f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384792.089660:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203450112 00000100:00100000:2.0:1787384792.089665:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203450112 00000100:00100000:2.0:1787384792.089698:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787384792.089704:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+14:23444:x1874208203450112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384792.089714:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384792.089725:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091400/0x7ef423838fba431a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba4313 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.089752:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091400/0x7ef423838fba431a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba4313 expref: 15 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.089763:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091400/0x7ef423838fba431a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4313 expref: 15 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.089770:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091400, rc 0) 00000100:00100000:2.0:1787384792.089821:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+15:23444:x1874208203450112:12345-0@lo:101:mount.lustre.0 Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.089828:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787384792.090016:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203450112:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384792.090026:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba4313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba431a expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384792.090037:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba4313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba431a expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384792.091693:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1787384792.092468:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384792.096644:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1787384792.096701:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1787384792.096717:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1787384792.096742:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1787384792.096767:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1787384792.096806:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1787384792.096822:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1787384792.096836:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1787384792.096850:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1787384792.096862:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1787384792.096876:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1787384792.096964:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1787384792.096984:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1787384792.096998:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1787384792.097013:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1787384792.097029:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1787384792.097042:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1787384792.097055:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1787384792.097071:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1787384792.097085:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1787384792.097108:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1787384792.097123:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1787384792.097137:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1787384792.097153:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1787384792.097168:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1787384792.097180:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1787384792.097194:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1787384792.097207:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1787384792.097231:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1787384792.097246:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1787384792.097259:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1787384792.097272:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1787384792.097286:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1787384792.097300:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1787384792.097314:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1787384792.097328:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1787384792.097418:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1787384792.097439:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1787384792.097454:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1787384792.097468:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1787384792.097483:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1787384792.097497:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1787384792.097511:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1787384792.097598:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1787384792.097634:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1787384792.097640:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1787384792.097744:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203450240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384792.098059:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384792.098136:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a18000 going to sleep for 11 seconds 00000100:00100000:2.0:1787384792.098180:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203450240 00000100:00100000:2.0:1787384792.098187:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203450240 00000100:00100000:2.0:1787384792.098272:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787384792.098283:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+15:23444:x1874208203450240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384792.098489:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+15:23444:x1874208203450240:12345-0@lo:501:mount.lustre.0 Request processed in 207us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.098498:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384792.098719:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203450240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384792.098760:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203450368:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384792.099241:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384792.099305:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c71863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384792.099400:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203450368 00000100:00100000:3.0:1787384792.099406:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203450368 00000100:00100000:3.0:1787384792.099481:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384792.099490:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+15:23444:x1874208203450368:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384792.100311:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+15:23444:x1874208203450368:12345-0@lo:503:mount.lustre.0 Request processed in 820us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384792.100327:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787384792.100599:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203450368:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787384792.101194:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384792.101295:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203450496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384792.101420:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384792.101504:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c71863c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384792.101609:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203450496 00000100:00100000:2.0:1787384792.101616:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203450496 00000100:00100000:2.0:1787384792.101698:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787384792.101707:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+15:23444:x1874208203450496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384792.102630:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+15:23444:x1874208203450496:12345-0@lo:502:mount.lustre.0 Request processed in 921us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384792.102641:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787384792.102755:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203450496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787384792.103111:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787384792.103141:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1787384792.103156:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1787384792.103170:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1787384792.103186:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1787384792.103201:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1787384792.103225:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1787384792.103241:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1787384792.103256:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1787384792.103268:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1787384792.103281:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1787384792.103293:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1787384792.103305:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1787384792.103318:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1787384792.103329:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1787384792.103468:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1787384792.103493:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1787384792.103508:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1787384792.103598:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1787384792.103616:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1787384792.103628:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1787384792.103639:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1787384792.103651:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1787384792.103665:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1787384792.103676:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1787384792.103687:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1787384792.103700:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1787384792.103714:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1787384792.103742:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1787384792.103756:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1787384792.103769:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1787384792.103858:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1787384792.103875:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1787384792.103888:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1787384792.103981:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1787384792.103996:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1787384792.104009:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1787384792.104023:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1787384792.104036:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1787384792.104053:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1787384792.104068:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1787384792.104082:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1787384792.104096:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1787384792.104110:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1787384792.104150:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203450624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384792.104226:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384792.104303:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c71863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384792.104404:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203450624 00000100:00100000:3.0:1787384792.104412:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203450624 00000100:00100000:3.0:1787384792.104507:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787384792.104516:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+15:23444:x1874208203450624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384792.104735:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+15:23444:x1874208203450624:12345-0@lo:502:mount.lustre.0 Request processed in 219us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384792.104742:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384792.104885:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203450624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787384792.105033:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1787384792.105042:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787384792.106224:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384792.106238:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384792.106240:0:23449:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787384792.106247:0:23449:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787384792.106250:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384792.106264:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff98f8f968cd40) 00000020:00000080:1.0:1787384792.106287:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787384792.106294:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787384792.106431:0:23449:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787384792.106447:0:23449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba4328 00000020:00000080:1.0:1787384792.106714:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787384792.106719:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384792.106723:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384792.106724:0:23449:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787384792.106727:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384792.106731:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384792.106733:0:23449:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787384792.106736:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384792.106744:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff98f8f9688000) 00000020:00000080:1.0:1787384792.106755:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787384792.106759:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787384792.106761:0:23449:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787384792.106764:0:23449:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787384792.106769:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787384792.107052:0:23449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8efb5a800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787384792.107066:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff98f8f968b380) 00000020:00000080:1.0:1787384792.107076:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787384792.107136:0:23449:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787384792.107141:0:23449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba433d 00000020:00000080:1.0:1787384792.107242:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787384792.107250:0:23449:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787384792.107254:0:23449:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x7ef423838fba4344 00080000:01000000:1.0:1787384792.107260:0:23449:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787384792.107263:0:23449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba434b 00010000:00010000:2.0:1787384792.216667:0:23449:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787384792.219429:0:23449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1787384792.220639:0:23449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787384792.224553:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787384792.224566:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384792.224581:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384792.224583:0:23449:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787384792.224587:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384792.224593:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384792.224594:0:23449:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787384792.224598:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787384792.224602:0:23449:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:00000080:2.0:1787384792.224627:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787384792.224643:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff98f8f593b380) 00000020:00000080:2.0:1787384792.224664:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787384792.224669:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787384792.224750:0:23449:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787384792.224757:0:23449:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787384792.224764:0:23449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba4359 00010000:00080000:2.0:1787384792.224823:0:23449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f7c4324800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.145@tcp at head 00010000:00010000:2.0:1787384792.231301:0:23449:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1787384792.249358:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787384792.249376:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787384792.249421:0:23449:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787384792.249444:0:23449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba4360 00000100:00080000:3.0:1787384792.249454:0:23449:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384792.249460:0:23449:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98f7c4324800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384792.249496:0:23449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f54fad80 x1874208203450752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384792.249646:0:23449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787384792.249741:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203450752:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787384792.249848:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787384792.250086:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384792.250092:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384792.250094:0:23449:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787384792.250097:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787384792.250099:0:23449:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787384792.250101:0:23449:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787384792.250102:0:23449:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787384792.250104:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787384792.250117:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384792.250118:0:23449:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787384792.250122:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384792.250126:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384792.250127:0:23449:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787384792.250131:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787384792.250167:0:23449:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787384792.250180:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384792.250183:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384792.250185:0:23449:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787384792.250187:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787384792.250189:0:23449:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1787384792.250190:0:23449:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787384792.250192:0:23449:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787384792.250194:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787384792.250196:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384792.250197:0:23449:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787384792.250199:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787384792.250203:0:23449:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787384792.250206:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384792.250207:0:23449:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787384792.250210:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787384792.250223:0:23449:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:01000000:3.0:1787384792.250245:0:23449:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787384792.250248:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384792.250260:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff98f8f7d34d40) 00000020:00000080:3.0:1787384792.250273:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787384792.250278:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787384792.250333:0:23449:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787384792.250402:0:23449:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787384792.250409:0:23449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba436e 00010000:00080000:3.0:1787384792.250438:0:23449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8f7d41800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384792.250970:0:23449:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1787384792.251500:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203450752 00000100:00100000:0.0:1787384792.251510:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203450752 00000100:00100000:0.0:1787384792.251561:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384792.251578:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203450752:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787384792.251606:0:22718:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:0.0:1787384792.251637:0:22718:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba4375 00000004:00100000:0.0:1787384792.251653:0:22718:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787384792.251658:0:22718:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1787384792.259495:0:22718:0:(import.c:65:import_set_state_nolock()) ffff98f7c40aa000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384792.259596:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874208203450752:12345-0@lo:38:llog_process_th.0 Request processed in 8016us (9746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384792.259608:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384792.259825:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787384792.259834:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1787384792.259843:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787384792.259848:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787384792.259851:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c4324800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787384792.259876:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203450752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787384792.260444:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384792.260461:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203450880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384792.260515:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787384792.260561:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787384792.260566:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787384792.260568:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8f7df1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384792.260573:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 683 00000100:00080000:2.0:1787384792.260577:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787384792.260582:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f7df1000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384792.260603:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f0ff0700 x1874208203451008/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384792.260621:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384792.260625:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384792.260636:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384792.260639:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787384792.260653:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203451008:0@lo:38:kworker.0 00000100:00100000:2.0:1787384792.260682:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384792.260730:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203450880 00000100:00100000:2.0:1787384792.260736:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203450880 00000100:00100000:2.0:1787384792.260987:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203451008 00000100:00100000:2.0:1787384792.260991:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203451008 00000100:00100000:2.0:1787384792.261006:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384792.261013:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1874208203450880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384792.261042:0:22718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787384792.261082:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1874208203450880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.261089:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384792.261104:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384792.261110:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203451008:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787384792.261165:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203451008:12345-0@lo:38:kworker.0 Request processed in 53us (480us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787384792.261170:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384792.261203:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203450880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384792.261241:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384792.261247:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7df1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384792.261250:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787384792.261253:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203451008:0@lo:38:kworker.0 00000100:00100000:2.0:1787384792.261290:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203451136:0@lo:400:kworker.0 00000100:00100000:2.0:1787384792.261322:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384792.261469:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203451136 00000100:00100000:2.0:1787384792.261474:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203451136 00000100:00100000:2.0:1787384792.261504:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384792.261511:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203451136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384792.261663:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203451136:12345-0@lo:400:kworker.0 Request processed in 151us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.261669:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787384792.261695:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f8f0ff0700 x1874208203451136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384792.261705:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203451136:0@lo:400:kworker.0 00000040:01000000:3.0:1787384792.262932:0:23449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787384792.263240:0:23449:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787384792.268225:0:23449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384792.270956:0:23449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1787384792.271156:0:23449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787384792.273571:0:23454:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787384792.273579:0:23454:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787384792.275735:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787384792.275750:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787384792.278831:0:23449:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787384792.278858:0:23449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba437c 00000100:00080000:3.0:1787384792.278869:0:23449:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384792.278875:0:23449:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98f8f7d41800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384792.278923:0:23449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f54fb800 x1874208203451264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384792.278954:0:23449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787384792.279031:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384792.279037:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384792.279039:0:23449:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787384792.279042:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787384792.279045:0:23449:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1787384792.279046:0:23449:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787384792.279048:0:23449:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787384792.279049:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787384792.279052:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384792.279053:0:23449:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787384792.279055:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787384792.279060:0:23449:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787384792.279063:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384792.279064:0:23449:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787384792.279068:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787384792.279072:0:23449:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:01000000:3.0:1787384792.279106:0:23449:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787384792.279108:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384792.279120:0:23449:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff98f8f7d30000) 00000020:00000080:3.0:1787384792.279135:0:23449:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1787384792.279140:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787384792.279225:0:23449:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787384792.279232:0:23449:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787384792.279238:0:23449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba438a 00010000:00080000:3.0:1787384792.279277:0:23449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8f943d000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384792.279488:0:23449:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787384792.279551:0:23449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787384792.279564:0:23449:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1787384792.283578:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384792.283587:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384792.283590:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384792.283594:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787384792.283912:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203451264:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787384792.283988:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203451264 offset 0 length 520: 4 00000040:00080000:2.0:1787384792.297510:0:23449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384792.298650:0:23449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1787384792.298880:0:23449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1787384792.300036:0:23456:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787384792.300042:0:23456:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787384792.301475:0:23449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787384792.301487:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787384792.301534:0:23449:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787384792.301556:0:23449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba4391 00000100:00080000:2.0:1787384792.301566:0:23449:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787384792.301572:0:23449:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f943d000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384792.301607:0:23449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f0ff0700 x1874208203451392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384792.301649:0:23449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787384792.301737:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203451392:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787384792.301832:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203451392 offset 0 length 520: 4 00000020:01000000:2.0:1787384792.302228:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384792.302233:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384792.302235:0:23449:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787384792.302238:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384792.302242:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384792.302243:0:23449:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787384792.302246:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787384792.302248:0:23449:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787384792.302250:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384792.302252:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384792.302253:0:23449:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787384792.302256:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384792.302258:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384792.302260:0:23449:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787384792.302263:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787384792.302290:0:23449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384792.302293:0:23449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384792.302294:0:23449:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787384792.302297:0:23449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:0.0:1787384792.302988:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1787384792.303019:0:23444:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787384792.303037:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba4313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba431a expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384792.303048:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba4313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba431a expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384792.303056:0:23444:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8efb5a800 from 1 10000000:01000000:0.0:1787384792.303060:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787384792.303098:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384792.303106:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384792.303117:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384792.303134:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203451520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787384792.303179:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384792.303211:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384792.303348:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203451520 00000100:00100000:3.0:1787384792.303356:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203451520 00000100:00100000:3.0:1787384792.303399:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787384792.303409:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+15:23444:x1874208203451520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384792.303421:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384792.303433:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902159a00/0x7ef423838fba439f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba4398 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.303454:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159a00/0x7ef423838fba439f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba4398 expref: 16 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.303465:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902159a00/0x7ef423838fba439f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4398 expref: 16 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.303474:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902159a00, rc 0) 00000100:00100000:3.0:1787384792.303514:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+16:23444:x1874208203451520:12345-0@lo:101:mount.lustre.0 Request processed in 106us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384792.303531:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787384792.303599:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203451520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384792.303613:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba439f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.303621:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba439f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384792.304392:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203451648:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787384792.304448:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384792.304469:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f96c9540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384792.304488:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203451648 00000100:00100000:3.0:1787384792.304492:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203451648 00000100:00100000:3.0:1787384792.304521:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384792.304528:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+16:23444:x1874208203451648:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787384792.304544:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787384792.304561:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787384792.304564:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1787384792.304634:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+16:23444:x1874208203451648:12345-0@lo:256:mount.lustre.0 Request processed in 105us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384792.304642:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384792.304679:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203451648:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787384792.305771:0:23444:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787384792.305800:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba439f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.305812:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba439f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384792.305833:0:23444:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8efb5a800 from 1 10000000:01000000:3.0:1787384792.305836:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384792.305865:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.305874:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.305883:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384792.305913:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203451776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384792.306451:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384792.306494:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f96c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384792.306682:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203451776 00000100:00100000:2.0:1787384792.306689:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203451776 00000100:00100000:2.0:1787384792.306736:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787384792.306745:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+16:23444:x1874208203451776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384792.306767:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384792.306810:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090000/0x7ef423838fba43ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba43a6 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.306833:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090000/0x7ef423838fba43ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba43a6 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.306857:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090000/0x7ef423838fba43ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba43a6 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.306865:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090000, rc 0) 00000100:00100000:2.0:1787384792.306916:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+17:23444:x1874208203451776:12345-0@lo:101:mount.lustre.0 Request processed in 171us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.306923:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787384792.307057:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203451776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384792.307071:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba43ad expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384792.307080:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba43ad expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384792.309133:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1787384792.309452:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384792.310261:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787384792.310292:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1787384792.310307:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1787384792.310320:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1787384792.310360:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1787384792.310376:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1787384792.310389:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1787384792.310401:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1787384792.310413:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787384792.310437:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1787384792.310450:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1787384792.310469:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1787384792.310474:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00080000:1.0:1787384792.310649:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384792.310654:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384792.310657:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384792.310660:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787384792.311078:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203451904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384792.311142:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384792.311259:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384792.312799:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203451904 00000100:00100000:2.0:1787384792.312810:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203451904 00000100:00100000:1.0:1787384792.313149:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787384792.313160:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+17:23444:x1874208203451904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384792.313315:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+17:23444:x1874208203451904:12345-0@lo:501:mount.lustre.0 Request processed in 157us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384792.313324:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787384792.313481:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203451904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384792.313528:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384792.313577:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384792.313610:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384792.313666:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203452032 00000100:00100000:1.0:1787384792.313671:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203452032 00000100:00100000:1.0:1787384792.313701:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787384792.313708:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+17:23444:x1874208203452032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384792.313816:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+17:23444:x1874208203452032:12345-0@lo:503:mount.lustre.0 Request processed in 107us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384792.313824:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787384792.313986:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452032:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787384792.314403:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787384792.314468:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452160:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384792.314507:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384792.314551:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384792.315302:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203452160 00000100:00100000:2.0:1787384792.315310:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203452160 00000100:00100000:2.0:1787384792.315364:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787384792.315374:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+17:23444:x1874208203452160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384792.315490:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+17:23444:x1874208203452160:12345-0@lo:502:mount.lustre.0 Request processed in 117us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.315498:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787384792.318226:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384792.318482:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1787384792.318515:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1787384792.318528:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1787384792.318540:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1787384792.318552:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1787384792.318566:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1787384792.318601:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1787384792.318617:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1787384792.318630:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1787384792.318642:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1787384792.318665:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1787384792.318700:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384792.318798:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384792.318846:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384792.319261:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203452288 00000100:00100000:3.0:1787384792.319268:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203452288 00000100:00100000:3.0:1787384792.319320:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787384792.319328:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+17:23444:x1874208203452288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384792.319461:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+17:23444:x1874208203452288:12345-0@lo:502:mount.lustre.0 Request processed in 132us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384792.319470:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787384792.321506:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452288:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787384792.321619:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1787384792.321633:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787384792.324251:0:23458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384792.324264:0:23458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384792.324266:0:23458:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787384792.324275:0:23458:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8efb5a800 00000020:00000080:1.0:1787384792.324289:0:23458:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787384792.324298:0:23458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384792.324300:0:23458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384792.324301:0:23458:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787384792.324303:0:23458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384792.324306:0:23458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384792.324307:0:23458:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787384792.324310:0:23458:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8efb5a800 00000020:00000080:1.0:1787384792.324312:0:23458:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787384792.324377:0:23458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384792.324380:0:23458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384792.324382:0:23458:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787384792.324385:0:23458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384792.324387:0:23458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384792.324389:0:23458:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787384792.324393:0:23458:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8efb5a800 00000020:00000080:1.0:1787384792.324395:0:23458:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787384792.324413:0:23458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384792.324415:0:23458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384792.324416:0:23458:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787384792.324418:0:23458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384792.324420:0:23458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384792.324421:0:23458:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787384792.324424:0:23458:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8efb5a800 00000020:00000080:1.0:1787384792.324426:0:23458:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787384792.324446:0:23458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384792.324450:0:23458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384792.324451:0:23458:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787384792.324454:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1787384792.324655:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787384792.324682:0:23444:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787384792.324706:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba43ad expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.324735:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba43ad expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384792.324903:0:23444:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787384792.324907:0:23444:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f8efb5a800 10000000:01000000:2.0:1787384792.324911:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f8efb5a800 10000000:01000000:2.0:1787384792.324921:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787384792.324928:0:23444:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8efb5a800 from 1 10000000:01000000:2.0:1787384792.324931:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787384792.325035:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba43b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.325046:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba43b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.325057:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba43b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384792.325086:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384792.325412:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384792.326058:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f96c9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384792.327677:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203452416 00000100:00100000:2.0:1787384792.327691:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203452416 00000100:00100000:2.0:1787384792.327743:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787384792.327763:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+17:23444:x1874208203452416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384792.327795:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384792.327816:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090200/0x7ef423838fba43bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba43b4 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.327845:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090200/0x7ef423838fba43bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba43b4 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.327856:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090200/0x7ef423838fba43bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba43b4 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.327865:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090200, rc 0) 00000100:00100000:2.0:1787384792.328117:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:23444:x1874208203452416:12345-0@lo:101:mount.lustre.0 Request processed in 365us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.328125:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787384792.328349:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384792.328370:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba43b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba43bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384792.328380:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba43b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba43bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384792.334001:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1787384792.334579:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384792.334759:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1787384792.334805:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1787384792.334819:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1787384792.334829:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1787384792.334840:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1787384792.334851:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1787384792.334861:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1787384792.334870:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1787384792.334880:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1787384792.334889:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1787384792.334915:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1787384792.334929:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1787384792.334943:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1787384792.334955:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1787384792.334967:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1787384792.334980:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1787384792.334993:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1787384792.335018:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1787384792.335032:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1787384792.335048:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1787384792.335060:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1787384792.335072:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1787384792.335082:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1787384792.335093:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1787384792.335104:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1787384792.335114:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1787384792.335151:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1787384792.335165:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1787384792.335176:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1787384792.335186:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1787384792.335195:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1787384792.335205:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1787384792.337338:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1787384792.337392:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1787384792.337410:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1787384792.337426:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1787384792.337440:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1787384792.337455:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1787384792.337471:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1787384792.337483:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1787384792.337496:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1787384792.337510:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1787384792.337548:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1787384792.337566:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1787384792.337579:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1787384792.337593:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1787384792.337609:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1787384792.337623:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1787384792.337831:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1787384792.337858:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1787384792.337894:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1787384792.337900:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1787384792.338005:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384792.338076:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384792.338154:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f96c93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384792.338249:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203452544 00000100:00100000:0.0:1787384792.338258:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203452544 00000100:00100000:0.0:1787384792.338308:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787384792.338317:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+18:23444:x1874208203452544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384792.338435:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+18:23444:x1874208203452544:12345-0@lo:501:mount.lustre.0 Request processed in 119us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384792.338444:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787384792.340829:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384792.340888:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384792.341024:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384792.341129:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203452672 00000100:00100000:0.0:1787384792.341137:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203452672 00000100:00100000:0.0:1787384792.341349:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787384792.341362:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:23444:x1874208203452672:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384792.341472:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:23444:x1874208203452672:12345-0@lo:503:mount.lustre.0 Request processed in 112us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384792.341479:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787384792.356650:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f96c93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384792.356696:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452672:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787384792.357925:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787384792.358153:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384792.358236:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384792.358283:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd4b7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384792.358385:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203452800 00000100:00100000:3.0:1787384792.358392:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203452800 00000100:00100000:3.0:1787384792.358441:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787384792.358450:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+18:23444:x1874208203452800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384792.358636:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+18:23444:x1874208203452800:12345-0@lo:502:mount.lustre.0 Request processed in 185us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384792.358644:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787384792.363069:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384792.363314:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1787384792.363353:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1787384792.363367:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1787384792.363381:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1787384792.363394:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1787384792.363408:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1787384792.363421:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1787384792.363435:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1787384792.363448:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1787384792.363459:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1787384792.363471:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1787384792.363483:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1787384792.363514:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1787384792.363544:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1787384792.363556:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1787384792.363570:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1787384792.363583:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1787384792.363594:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1787384792.363606:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1787384792.363616:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1787384792.363626:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1787384792.363638:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1787384792.363650:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1787384792.363664:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1787384792.363677:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1787384792.363691:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1787384792.363705:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1787384792.363718:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1787384792.363746:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1787384792.363761:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1787384792.363775:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1787384792.363814:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1787384792.363828:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1787384792.363842:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1787384792.363866:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1787384792.363880:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1787384792.363904:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1787384792.363919:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1787384792.363932:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1787384792.363944:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1787384792.363957:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1787384792.363970:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1787384792.363982:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1787384792.363995:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1787384792.364019:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1787384792.364035:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1787384792.364048:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1787384792.364061:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1787384792.364115:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384792.364194:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384792.364253:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203452928 00000100:00100000:0.0:1787384792.364260:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203452928 00000100:00100000:0.0:1787384792.364313:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384792.364322:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+18:23444:x1874208203452928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384792.364429:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+18:23444:x1874208203452928:12345-0@lo:502:mount.lustre.0 Request processed in 107us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384792.364436:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384792.364489:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd4b7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384792.364507:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203452928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384792.364664:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1787384792.364685:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1787384792.364703:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203453056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384792.364738:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384792.364759:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203453056 00000100:00100000:0.0:1787384792.364762:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203453056 00000100:00100000:0.0:1787384792.364804:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787384792.364810:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:23444:x1874208203453056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384792.364862:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:23444:x1874208203453056:12345-0@lo:502:mount.lustre.0 Request processed in 51us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384792.364867:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787384792.364895:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1dc540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384792.364906:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203453056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384792.364943:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1787384792.364950:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787384792.375198:0:23462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787384792.375225:0:23462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff98f8f7d33380) 00000020:00000080:3.0:1787384792.375248:0:23462:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787384792.375450:0:23462:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8efb5a800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787384792.375454:0:23462:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8efb5a800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787384792.375457:0:23462:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8efb5a800 3 00010000:00080000:3.0:1787384792.375486:0:23462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8ee311000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384792.379487:0:23462:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787384792.379595:0:23462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787384792.379640:0:23462:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787384792.379655:0:23462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x7ef423838fba43c9 00000100:00080000:3.0:1787384792.379665:0:23462:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384792.379676:0:23462:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98f8ee311000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384792.379711:0:23462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f54f9180 x1874208203453184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384792.379770:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874208203453184:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787384792.379868:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384792.379935:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203453184 00000100:00100000:3.0:1787384792.379942:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203453184 00000100:00100000:3.0:1787384792.379973:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384792.379980:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874208203453184:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787384792.380001:0:22713:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:3.0:1787384792.380043:0:22713:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x7ef423838fba43d0 00000004:00100000:3.0:1787384792.380059:0:22713:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787384792.380088:0:22713:0:(import.c:65:import_set_state_nolock()) ffff98f8ee316800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384792.380137:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874208203453184:12345-0@lo:38:llog_process_th.0 Request processed in 156us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384792.380145:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787384792.380182:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f8f54f9180 x1874208203453184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384792.380191:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787384792.380198:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787384792.380205:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787384792.380208:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787384792.380210:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8ee311000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787384792.388688:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874208203453184:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787384792.388724:0:23462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787384792.389022:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384792.389027:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384792.389030:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384792.389033:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787384792.392409:0:23462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1787384792.395967:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787384792.396007:0:23444:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787384792.396023:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba43b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba43bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384792.396047:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba43b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba43bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787384792.396102:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787384792.396104:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787384792.396105:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384792.396106:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384792.396107:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384792.396109:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384792.396110:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384792.396112:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384792.396113:0:23444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384792.396117:0:23444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1787384792.396120:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787384792.396121:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787384792.396122:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384792.396123:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384792.396124:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384792.396125:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384792.396127:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384792.396128:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384792.396129:0:23444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384792.396155:0:23444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787384792.396174:0:23444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203453312:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787384792.396263:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384792.396305:0:23444:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787384792.396337:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203453312 00000100:00100000:1.0:1787384792.396343:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203453312 00000100:00100000:1.0:1787384792.396384:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787384792.396392:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:23444:x1874208203453312:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787384792.396418:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787384792.396433:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787384792.398149:0:22692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787384792.399009:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787384792.399024:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787384792.399176:0:22729:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787384792.399181:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787384792.399203:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.399232:0:22729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902158400/0x7ef423838fba42db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba42d4 expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.399239:0:22729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902159a00/0x7ef423838fba439f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4398 expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.399253:0:22729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.399287:0:22729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902159a00/0x7ef423838fba439f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba4398 expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.399301:0:22729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f902159a00/0x7ef423838fba439f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba4398 expref: 18 pid: 22706 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384792.399319:0:22729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203453440:0@lo:104: 00000100:00100000:2.0:1787384792.399378:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384792.399421:0:22729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902158400/0x7ef423838fba42db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba42d4 expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.399429:0:22729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f902158400/0x7ef423838fba42db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba42d4 expref: 18 pid: 22706 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384792.399437:0:22729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203453568:0@lo:104: 00000100:00100000:2.0:1787384792.399459:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384792.399473:0:22729:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c4052180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384792.399491:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203453440 00000100:00100000:2.0:1787384792.399496:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203453440 00000100:00100000:2.0:1787384792.399527:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203453568 00000100:00100000:2.0:1787384792.399531:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203453568 00000100:00100000:2.0:1787384792.399544:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384792.399551:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+4:22729:x1874208203453440:12345-0@lo:104: 00010000:00010000:2.0:1787384792.399562:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba439f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.399620:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384792.399627:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+4:22729:x1874208203453440:12345-0@lo:104: Request processed in 76us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.399635:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384792.399653:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384792.399659:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+3:22729:x1874208203453568:12345-0@lo:104: 00010000:00010000:2.0:1787384792.399666:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba42db expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.399696:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787384792.399701:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+3:22729:x1874208203453568:12345-0@lo:104: Request processed in 43us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.399707:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384792.399737:0:22729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203453440:0@lo:104: 00000100:00100000:2.0:1787384792.399745:0:22729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203453568:0@lo:104: 00010000:00010000:2.0:1787384792.401282:0:22729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.401309:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384792.401315:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba439f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.401322:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04000 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384792.401325:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba439f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.401334:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba439f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384792.401349:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba439f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384792.401354:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384792.401388:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba439f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.401395:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384792.401413:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba439f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.401421:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04000/0x7ef423838fba4398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba439f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.401433:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384792.401437:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba42db expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.401442:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384792.401445:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba42db expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.401451:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba42db expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384792.401457:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba42db expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384792.401461:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384792.401481:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba42db expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.401488:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384792.401504:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba42db expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.401510:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba42d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba42db expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.401523:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384792.401524:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384792.401526:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384792.401532:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384792.401625:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a654d8f2-2ab4-4025-870e-e3edf79de730:3654:1874208203453696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384792.401673:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384792.401722:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203453824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384792.401743:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384792.401792:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203453696 00000100:00100000:2.0:1787384792.401798:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203453696 00010000:00010000:2.0:1787384792.401819:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902159a00/0x7ef423838fba439f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba4398 expref: 19 pid: 22706 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384792.401842:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203453824 00000100:00100000:2.0:1787384792.401845:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203453824 00010000:00010000:2.0:1787384792.401854:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902158400/0x7ef423838fba42db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba42d4 expref: 20 pid: 22706 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384792.401866:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384792.401873:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+20:3654:x1874208203453696:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384792.402111:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+20:23444:x1874208203453312:12345-0@lo:253:mount.lustre.0 Request processed in 5719us (5846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384792.402121:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787384792.402180:0:23444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:23444:1874208203453312:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787384792.402191:0:23444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787384792.402194:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787384792.402195:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787384792.402203:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384792.402204:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384792.402206:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384792.402207:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384792.402208:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787384792.402210:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384792.402220:0:23444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787384792.402234:0:23444:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787384792.404252:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384792.404268:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902159a00/0x7ef423838fba439f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba4398 expref: 19 pid: 22706 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404285:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902159a00/0x7ef423838fba439f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba4398 expref: 19 pid: 22706 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404305:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159a00/0x7ef423838fba439f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba4398 expref: 19 pid: 22706 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404319:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384792.404382:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:3654:x1874208203453696:12345-0@lo:103:ldlm_bl.0 Request processed in 2507us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.404391:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384792.404417:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384792.404427:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+17:3651:x1874208203453824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384792.404438:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384792.404443:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902158400/0x7ef423838fba42db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba42d4 expref: 17 pid: 22706 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404451:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902158400/0x7ef423838fba42db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba42d4 expref: 17 pid: 22706 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404460:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902158400/0x7ef423838fba42db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba42d4 expref: 17 pid: 22706 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404471:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404478:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787384792.404499:0:22697:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005319371s 00010000:00010000:2.0:1787384792.404504:0:22697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404512:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404518:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404525:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404531:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384792.404536:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404544:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404558:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404567:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384792.404595:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+16:3651:x1874208203453824:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (2851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.404601:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384792.404656:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203453824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384792.404682:0:22729:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404695:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384792.404701:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090800/0x7ef423838fba43d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384792.404728:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a654d8f2-2ab4-4025-870e-e3edf79de730:3654:1874208203453696:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1787384792.413313:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787384792.413403:0:23469:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787384792.413407:0:23469:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787384792.413627:0:23470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787384792.413920:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1787384792.414145:0:23470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384792.417833:0:23470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787384792.421652:0:23470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1787384792.425208:0:23471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23471:1874208203453952:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787384792.425288:0:23471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384792.425322:0:23471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384792.426121:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203453952 00000100:00100000:2.0:1787384792.426130:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203453952 00000100:00100000:2.0:1787384792.426182:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384792.426191:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23471:x1874208203453952:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787384792.426295:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23471:x1874208203453952:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 104us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.426302:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384792.426441:0:23471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23471:1874208203453952:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787384792.426474:0:23471:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787384792.426509:0:23471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23471:1874208203454080:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787384792.426546:0:23471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384792.426570:0:23471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c4052180 going to sleep for 11 seconds 00000100:00100000:3.0:1787384792.426613:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203454080 00000100:00100000:3.0:1787384792.426617:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203454080 00000100:00100000:3.0:1787384792.426648:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384792.426655:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23471:x1874208203454080:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787384792.426768:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23471:x1874208203454080:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 113us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384792.426774:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384792.427059:0:23471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23471:1874208203454080:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787384792.427118:0:23471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23471:1874208203454208:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787384792.427148:0:23471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384792.427171:0:23471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787384792.428874:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203454208 00000100:00100000:1.0:1787384792.428886:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203454208 00000100:00100000:1.0:1787384792.429002:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384792.429010:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23471:x1874208203454208:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787384792.429087:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23471:x1874208203454208:12345-0@lo:900:lod0001_rec0000.0 Request processed in 78us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384792.429094:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787384792.429186:0:23471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f8f0ff2300 x1874208203454208/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787384808 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384792.429209:0:23471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23471:1874208203454208:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787384792.429286:0:23471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23471:1874208203454336:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787384792.429322:0:23471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384792.429417:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203454336 00000100:00100000:2.0:1787384792.429421:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203454336 00000100:00100000:2.0:1787384792.429455:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384792.429462:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23471:x1874208203454336:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787384792.429519:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23471:x1874208203454336:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 58us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384792.429525:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384792.429544:0:23471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384792.429558:0:23471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23471:1874208203454336:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787384792.429605:0:23471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787384792.431227:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787384792.431270:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787384792.431706:0:23444:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787384792.431714:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787384792.431749:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384792.432757:0:23444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787384792.433294:0:23444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787384792.433322:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787384792.433502:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384792.434859:0:23471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787384792.434925:0:23471:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787384792.434928:0:23471:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:0.0:1787384792.436447:0:23444:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:0.0:1787384792.442960:0:23444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1787384792.448193:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00000001:00080000:0.0:1787384792.455315:0:23444:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787384792.455412:0:23444:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffac6941853988 00100000:10000000:0.0:1787384792.455421:0:23444:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787384792.457753:0:23444:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787384792.457805:0:23444:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787384792.457821:0:23444:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787384792.457842:0:23444:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787384792.458692:0:23444:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384792.463325:0:23444:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787384792.951000:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384793.469419:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00000040:00080000:2.0:1787384793.469864:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787384793.658528:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787384793.658538:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8efb5a800 from 12 10000000:01000000:3.0:1787384793.658544:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787384793.658602:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384793.658615:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384793.658626:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384793.658654:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203454464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384793.658729:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384793.658768:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384793.658957:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203454464 00000100:00100000:1.0:1787384793.658965:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203454464 00000100:00100000:1.0:1787384793.659021:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787384793.659031:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+16:22709:x1874208203454464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384793.659044:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384793.659057:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba43e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba43de expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384793.659081:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba43e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba43de expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384793.659091:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba43e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba43de expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384793.659099:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ba00, rc 0) 00000100:00100000:1.0:1787384793.659137:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+17:22709:x1874208203454464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384793.659152:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787384793.663336:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203454464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384793.663367:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba43e5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384793.663380:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba43e5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384793.663450:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203454592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787384793.663511:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384793.663547:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384793.663673:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203454592 00000100:00100000:1.0:1787384793.663680:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203454592 00000100:00100000:1.0:1787384793.663731:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787384793.663741:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+17:22709:x1874208203454592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787384793.663761:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787384793.663797:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787384793.663801:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787384793.663886:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+17:22709:x1874208203454592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384793.663894:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787384793.663996:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203454592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787384793.664040:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787384793.664047:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba43e5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384793.664056:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba43e5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384793.664066:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787384793.664068:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f0fb9000 from 12 10000000:01000000:3.0:1787384793.664071:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787384793.664092:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384793.664099:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384793.664118:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384793.664131:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203454720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384793.664157:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384793.664173:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384793.664231:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203454720 00000100:00100000:1.0:1787384793.664236:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203454720 00000100:00100000:1.0:1787384793.664266:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787384793.664273:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+17:22709:x1874208203454720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384793.664282:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384793.664295:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965a600/0x7ef423838fba43f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba43ec expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384793.664312:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965a600/0x7ef423838fba43f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba43ec expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384793.664321:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965a600/0x7ef423838fba43f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba43ec expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384793.664341:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a600, rc 0) 00000100:00100000:1.0:1787384793.664370:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+18:22709:x1874208203454720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384793.664386:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787384793.664506:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203454720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384793.664517:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba43f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384793.664525:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba43f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384793.664563:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203454848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787384793.664590:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384793.664612:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384793.664806:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203454848 00000100:00100000:1.0:1787384793.664810:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203454848 00000100:00100000:1.0:1787384793.664838:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787384793.664845:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+18:22709:x1874208203454848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787384793.664854:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787384793.664867:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787384793.664870:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787384793.664930:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+18:22709:x1874208203454848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 85us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384793.664936:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787384793.665021:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203454848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787384793.665052:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787384793.665057:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba43f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384793.665065:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba43f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384793.976637:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787384794.487431:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787384794.488157:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00010000:00010000:2.0:1787384795.000967:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384795.510883:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00010000:00010000:2.0:1787384796.029010:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384796.538207:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00010000:00010000:3.0:1787384797.046913:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384797.559583:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 0 seconds 00000100:00100000:3.0:1787384797.623367:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384797.623389:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203454976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384797.623460:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384797.623557:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203454976 00000100:00100000:2.0:1787384797.623566:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203454976 00000100:00100000:3.0:1787384797.623678:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787384797.623689:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203454976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384797.623726:0:22718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787384797.623894:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203454976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384797.624020:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203454976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 332us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384797.624029:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787384797.627628:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787384797.627635:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787384797.627639:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8f7df1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384797.627651:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f7df1000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384797.630608:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384797.630672:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8ee114700 x1874208203455232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384797.630714:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a654d8f2-2ab4-4025-870e-e3edf79de730:3654:1874208203455104:0@lo:400:kworker.0 00000100:00080000:1.0:1787384797.630985:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384797.630990:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384797.630992:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384797.630995:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787384797.631013:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787384797.631020:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384797.631023:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384797.631026:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384797.631036:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787384797.631094:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203455488:0@lo:400:kworker.0 00000100:00100000:3.0:1787384797.631190:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203455232:0@lo:38:kworker.0 00000100:00100000:1.0:1787384797.631664:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384797.631907:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203455488 00000100:00100000:1.0:1787384797.631915:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203455488 00000100:00100000:1.0:1787384797.631962:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384797.631971:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203455488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384797.632025:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203455488:12345-0@lo:400:kworker.0 Request processed in 55us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384797.632033:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787384797.632073:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8ee114380 x1874208203455488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384797.632088:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203455488:0@lo:400:kworker.0 00000100:00100000:1.0:1787384797.632142:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384797.632152:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203455360:0@lo:400:kworker.0 00000100:00100000:1.0:1787384797.632190:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384797.632221:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203455360 00000100:00100000:1.0:1787384797.632225:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203455360 00000100:00100000:1.0:1787384797.632247:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384797.632253:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203455360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384797.632356:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203455360:12345-0@lo:400:kworker.0 Request processed in 101us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384797.632363:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787384797.632387:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8ee117100 x1874208203455360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384797.632411:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203455360:0@lo:400:kworker.0 00000100:00100000:1.0:1787384797.632438:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203455104 00000100:00100000:1.0:1787384797.632442:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203455104 00000100:00100000:1.0:1787384797.632466:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787384797.632472:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:3654:x1874208203455104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384797.632505:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:3654:x1874208203455104:12345-0@lo:400:kworker.0 Request processed in 32us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384797.632511:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787384797.634853:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a654d8f2-2ab4-4025-870e-e3edf79de730:3654:1874208203455104:0@lo:400:kworker.0 00000100:00100000:3.0:1787384797.639988:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384797.640172:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203455232 00000100:00100000:1.0:1787384797.640189:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203455232 00000100:00100000:1.0:1787384797.640236:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787384797.640244:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203455232:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787384797.640276:0:22719:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:1.0:1787384797.640314:0:22719:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba43fa 00000004:00100000:1.0:1787384797.640330:0:22719:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787384797.640337:0:22719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1787384797.654090:0:22719:0:(import.c:65:import_set_state_nolock()) ffff98f8c8924000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384797.654203:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874208203455232:12345-0@lo:38:kworker.0 Request processed in 13955us (14219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384797.654216:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787384797.654383:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787384797.654394:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787384797.654401:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787384797.654405:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7df1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787384797.654603:0:3650:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000002511cd9): req@ffff98f8ee117b80 x1874208203447808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384797.654627:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203455232:0@lo:38:kworker.0 00000100:00100000:1.0:1787384797.654723:0:22755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384797.654774:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384797.655100:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203447808 00000100:00100000:3.0:1787384797.655108:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203447808 00000100:00100000:3.0:1787384797.655157:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787384797.655166:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22755:x1874208203447808:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787384797.655276:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22755:x1874208203447808:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 109us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384797.655286:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203455616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384797.655289:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787384797.655323:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384797.655355:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203455616 00000100:00100000:3.0:1787384797.655361:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203455616 00000100:00100000:3.0:1787384797.655412:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787384797.655424:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874208203455616:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384797.655426:0:22755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22755:1874208203447808:0@lo:1000:lod0000_rec0001.0 00000004:00000024:3.0:1787384797.655465:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787384797.655515:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874208203455616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384797.655523:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384797.655530:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203455616:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1787384797.655734:0:22755:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787384797.656011:0:22755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22755:1874208203455744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787384797.656161:0:22755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384797.656225:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7027d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384797.656269:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203455744 00000100:00100000:0.0:1787384797.656275:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203455744 00000100:00100000:0.0:1787384797.656352:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787384797.656361:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22755:x1874208203455744:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787384797.656506:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22755:x1874208203455744:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 146us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384797.656514:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787384797.656732:0:22755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22755:1874208203455744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787384797.656842:0:22755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22755:1874208203455872:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787384797.656868:0:22755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384797.657067:0:22755:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7027d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384797.657092:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203455872 00000100:00100000:1.0:1787384797.657097:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203455872 00000100:00100000:1.0:1787384797.657120:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384797.657127:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22755:x1874208203455872:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787384797.657204:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22755:x1874208203455872:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 76us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384797.657211:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384797.657239:0:22755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22755:1874208203455872:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787384797.657279:0:22755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787384797.662104:0:22755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787384797.662204:0:22755:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1787384797.662210:0:22755:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787384798.086369:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787384798.439670:0:23714:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787384799.094880:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787384799.403656:0:23767:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787384799.404013:0:23767:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787384800.124395:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787384800.359453:0:23817:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384800.359663:0:23817:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1787384800.633455:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787384801.142964:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787384801.293563:0:23866:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe2f868240 00000020:00000080:2.0:1787384801.293578:0:23866:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787384801.293582:0:23866:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787384801.293590:0:23866:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2f86a4d0 20000000:00000080:2.0:1787384801.293597:0:23866:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f8c5a69000 uarg=0000000000000000 20000000:01000000:2.0:1787384801.293638:0:23866:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787384801.293645:0:23866:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787384801.293650:0:23866:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787384801.294298:0:23867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1787384801.294514:0:23866:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787384801.305175:0:23866:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787384801.305209:0:23866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384801.305232:0:23866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba42aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba42a3 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384801.305240:0:23866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2090000/0x7ef423838fba43ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba43a6 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384801.305247:0:23866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384801.305349:0:23866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2090000/0x7ef423838fba43ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba43a6 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384801.305365:0:23866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c2090000/0x7ef423838fba43ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba43a6 expref: 17 pid: 22707 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384801.305380:0:23866:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23866:1874208203456000:0@lo:104: 00000100:00100000:3.0:1787384801.305446:0:23866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384801.305552:0:23866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba42aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba42a3 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384801.305561:0:23866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba42aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba42a3 expref: 17 pid: 22707 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384801.305589:0:23866:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23866:1874208203456128:0@lo:104: 00000100:00100000:3.0:1787384801.305614:0:23866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384801.306398:0:23866:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a18f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384801.306789:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203456000 00000100:00100000:0.0:1787384801.306798:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203456000 00000100:00100000:0.0:1787384801.306836:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203456128 00000100:00100000:0.0:1787384801.306839:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203456128 00000100:00100000:0.0:1787384801.306854:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384801.306863:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+4:23866:x1874208203456000:12345-0@lo:104: 00010000:00010000:0.0:1787384801.306877:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba43ad expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384801.307057:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384801.307065:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+4:23866:x1874208203456000:12345-0@lo:104: Request processed in 203us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384801.307084:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384801.307102:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384801.307109:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+3:23866:x1874208203456128:12345-0@lo:104: 00010000:00010000:0.0:1787384801.307118:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba42aa expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384801.307215:0:23866:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23866:1874208203456000:0@lo:104: 00000100:00100000:3.0:1787384801.307225:0:23866:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23866:1874208203456128:0@lo:104: 00010000:00010000:3.0:1787384801.307249:0:23866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.307422:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384801.307436:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba43ad expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.307444:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158000 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384801.307447:0:22701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba43ad expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.307456:0:22701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba43ad expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384801.307463:0:22701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba43ad expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384801.307468:0:22701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787384801.307504:0:22701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba43ad expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.307512:0:22701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384801.307536:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba43ad expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.307543:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba43a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba43ad expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.307557:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384801.307560:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba42aa expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.307566:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158c00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384801.307568:0:22701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba42aa expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.307586:0:22701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba42aa expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384801.307593:0:22701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba42aa expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384801.307598:0:22701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787384801.307610:0:22701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba42aa expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.307615:0:22701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384801.307621:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba42aa expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.307626:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba42a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba42aa expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.307639:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384801.307641:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384801.307642:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384801.307656:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203456256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384801.307691:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384801.307721:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384801.307727:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203456384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384801.307747:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384801.307878:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203456256 00000100:00100000:1.0:1787384801.307883:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203456256 00010000:00010000:1.0:1787384801.307902:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2090000/0x7ef423838fba43ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba43a6 expref: 18 pid: 22707 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384801.307935:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203456384 00000100:00100000:1.0:1787384801.307939:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203456384 00010000:00010000:1.0:1787384801.307951:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba42aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba42a3 expref: 19 pid: 22707 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384801.307964:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384801.307971:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+19:3653:x1874208203456256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384801.308057:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384801.308063:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2090000/0x7ef423838fba43ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba43a6 expref: 19 pid: 22707 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308074:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2090000/0x7ef423838fba43ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba43a6 expref: 19 pid: 22707 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308088:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090000/0x7ef423838fba43ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba43a6 expref: 19 pid: 22707 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308101:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384801.308132:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+18:3653:x1874208203456256:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384801.308139:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384801.308166:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384801.308173:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+17:3653:x1874208203456384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384801.308182:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384801.308186:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba42aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba42a3 expref: 17 pid: 22707 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308195:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba42aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba42a3 expref: 17 pid: 22707 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308212:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba42aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba42a3 expref: 17 pid: 22707 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308222:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308230:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308244:0:22698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308251:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308258:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308264:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308269:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384801.308273:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308935:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308949:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384801.308973:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384801.309074:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+16:3653:x1874208203456384:12345-0@lo:103:ldlm_bl.0 Request processed in 901us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384801.309082:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384801.309128:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203456384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384801.309138:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203456256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384801.309218:0:23866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384801.309227:0:23866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384801.309234:0:23866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba4401 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384801.310401:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787384801.310413:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+3:23866:x1874208203456128:12345-0@lo:104: Request processed in 3302us (4796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384801.310423:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787384801.310492:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384802.169762:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787384802.615581:0:22709:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384802.615589:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8efb5a800 from 13 10000000:01000000:3.0:1787384802.615593:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384802.615643:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384802.615656:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384802.615667:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384802.615705:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203456512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384802.615771:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384802.615834:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a18f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384802.624200:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203456512 00000100:00100000:2.0:1787384802.624214:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203456512 00000100:00100000:2.0:1787384802.624282:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787384802.624293:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+16:22709:x1874208203456512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384802.624310:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384802.624349:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090000/0x7ef423838fba440f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba4408 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384802.624377:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090000/0x7ef423838fba440f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba4408 expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384802.624388:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090000/0x7ef423838fba440f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4408 expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384802.624398:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090000, rc 0) 00000100:00100000:2.0:1787384802.624582:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+17:22709:x1874208203456512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 291us (8810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384802.624590:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787384802.625051:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203456512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384802.625071:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba440f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384802.625082:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba440f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384802.625184:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203456640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384802.625225:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384802.625254:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384802.625374:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203456640 00000100:00100000:3.0:1787384802.625380:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203456640 00000100:00100000:3.0:1787384802.625418:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787384802.625426:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+17:22709:x1874208203456640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384802.625539:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+17:22709:x1874208203456640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384802.625547:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787384802.625581:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203456640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384802.625612:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203456768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384802.625654:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384802.625668:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a18540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384802.625681:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203456768 00000100:00100000:3.0:1787384802.625685:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203456768 00000100:00100000:3.0:1787384802.625706:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787384802.625713:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+17:22709:x1874208203456768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384802.625810:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+17:22709:x1874208203456768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384802.625817:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787384802.625857:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203456768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787384802.626449:0:23916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787384802.626506:0:22709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787384802.626535:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384802.626543:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba440f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384802.626553:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba440f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384802.626562:0:22709:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384802.626565:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f0fb9000 from 13 10000000:01000000:3.0:1787384802.626568:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384802.626593:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384802.626600:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384802.626608:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384802.626625:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203456896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384802.626662:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384802.626677:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a18f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384802.626692:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203456896 00000100:00100000:3.0:1787384802.626696:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203456896 00000100:00100000:3.0:1787384802.626724:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787384802.626730:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+17:22709:x1874208203456896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384802.626739:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384802.626752:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba441d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba4416 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384802.626807:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba441d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba4416 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384802.626818:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba441d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4416 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384802.626828:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cca00, rc 0) 00000100:00100000:3.0:1787384802.626861:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:22709:x1874208203456896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384802.626867:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787384802.626905:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203456896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384802.626916:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba441d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384802.626925:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba441d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384802.626964:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203457024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384802.626987:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384802.626999:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a18f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384802.627010:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203457024 00000100:00100000:3.0:1787384802.627013:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203457024 00000100:00100000:3.0:1787384802.627031:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787384802.627036:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:22709:x1874208203457024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384802.627116:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:22709:x1874208203457024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384802.627131:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787384802.627177:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203457024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384802.627200:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203457152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384802.627235:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384802.627248:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a18f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384802.627259:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203457152 00000100:00100000:3.0:1787384802.627262:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203457152 00000100:00100000:3.0:1787384802.627281:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787384802.627286:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:22709:x1874208203457152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384802.627350:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:22709:x1874208203457152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384802.627357:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787384802.627394:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203457152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787384802.642681:0:23917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787384802.642930:0:22709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787384802.642952:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384802.642964:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba441d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384802.642975:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba441d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384802.742953:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384802.742975:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203457280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384802.743039:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384802.745479:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203457408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384802.745606:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384792/real 1787384792] req@ffff98f8f0ff0700 x1874208203451392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384802 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384802.745631:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f0ff0700 x1874208203451392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384802 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384802.745642:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384792/real 1787384792] req@ffff98f8f54fb800 x1874208203451264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384802 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384802.745656:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f54fb800 x1874208203451264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384802 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384802.745665:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384787/real 1787384787] req@ffff98f8f0ff1880 x1874208203448832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384802 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384802.745678:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f0ff1880 x1874208203448832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384802 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384802.745692:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384802.745710:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787384802.745714:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203451392:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787384802.745719:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d41800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384802.745723:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787384802.745726:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203451264:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787384802.745731:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c354a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384802.745734:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787384802.745737:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203448832:0@lo:8:kworker.0 00000100:00080000:2.0:1787384802.745770:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384802.745797:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787384802.745799:0:36:0:(import.c:65:import_set_state_nolock()) ffff98f7c354a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384802.745804:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 682 00000100:00080000:2.0:1787384802.745809:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787384802.745814:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f7c354a000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384802.745855:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f0ff1880 x1874208203457536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384802.745874:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384802.745877:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384802.745905:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384802.745908:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787384802.745909:0:36:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d41800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384802.745912:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 687 00000100:00080000:2.0:1787384802.745915:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787384802.745919:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98f8f7d41800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384802.745928:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f0ff2a00 x1874208203457920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384802.745936:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384802.745939:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787384802.745940:0:36:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384802.745943:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 687 00000100:00080000:2.0:1787384802.745946:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787384802.745948:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f943d000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384802.745958:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f0ff1f80 x1874208203458048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787384802.745997:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203457792:0@lo:400:kworker.0 00000100:00100000:1.0:1787384802.749859:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203458176:0@lo:400:kworker.0 00000100:00100000:1.0:1787384802.749932:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384802.749983:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203457280 00000100:00100000:1.0:1787384802.749990:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203457280 00000100:00100000:1.0:1787384802.750030:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384802.750038:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874208203457280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384802.750358:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384802.750404:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874208203457280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 366us (7364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384802.750412:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384802.750439:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203457664:0@lo:400:kworker.0 00000100:00100000:1.0:1787384802.750465:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384802.750494:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203458176 00000100:00100000:1.0:1787384802.750498:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203458176 00000100:00100000:1.0:1787384802.750520:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203457664 00000100:00100000:1.0:1787384802.750524:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203457664 00000100:00100000:1.0:1787384802.750535:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787384802.750541:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203458176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384802.750772:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203458176:12345-0@lo:400:kworker.0 Request processed in 230us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384802.750796:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787384802.750810:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384802.750816:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203457664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384802.750863:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203457664:12345-0@lo:400:kworker.0 Request processed in 47us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384802.750869:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787384802.750908:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f0ff0700 x1874208203457664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384802.750922:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203457664:0@lo:400:kworker.0 00000100:00100000:2.0:1787384802.753999:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384802.754031:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203457792 00000100:00100000:1.0:1787384802.754039:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203457792 00000100:00100000:2.0:1787384802.754061:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203457536:0@lo:8:kworker.0 00000100:00100000:1.0:1787384802.754090:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000400:00000100:2.0:1787384802.754096:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203457536 offset 0 length 520: 4 00000100:00100000:1.0:1787384802.754098:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203457792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384802.754116:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203457920:0@lo:8:kworker.0 00000400:00000100:2.0:1787384802.754129:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203457920 offset 0 length 520: 4 00000100:00100000:2.0:1787384802.754139:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203458048:0@lo:8:kworker.0 00000400:00000100:2.0:1787384802.754169:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203458048 offset 0 length 520: 4 00000100:00100000:1.0:1787384802.754178:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203457792:12345-0@lo:400:kworker.0 Request processed in 81us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384802.754186:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787384802.754205:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203457792:0@lo:400:kworker.0 00010000:00080000:3.0:1787384802.754487:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f0ff1180 x1874208203458176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384802.754501:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203458176:0@lo:400:kworker.0 00000100:00100000:1.0:1787384802.755605:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384802.755714:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203457280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384802.756535:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203457408 00000100:00100000:2.0:1787384802.756542:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203457408 00000100:00100000:2.0:1787384802.756699:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787384802.756708:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203457408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384802.756739:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787384802.756813:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203457408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384802.756820:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384802.757022:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203457408:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787384803.191615:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384803.766894:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384788/real 1787384788] req@ffff98f8f4a47100 x1874208203449344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384803 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384803.766922:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f4a47100 x1874208203449344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384803 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384803.766942:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d9b5c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384803.766985:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787384803.766989:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203449344:0@lo:8:kworker.0 00000100:00080000:0.0:1787384803.767208:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384803.767212:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384803.767214:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384803.767217:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787384803.767220:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8d9b5c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384803.767224:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 683 00000100:00080000:0.0:1787384803.767229:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787384803.767234:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f8d9b5c800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384803.767251:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f4a44a80 x1874208203458560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384803.767274:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384803.767277:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384803.767280:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384803.767283:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787384803.767306:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203458688:0@lo:400:kworker.0 00000100:00100000:0.0:1787384803.767367:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384803.767387:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203458816:0@lo:400:kworker.0 00000100:00100000:0.0:1787384803.767399:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384803.767408:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203458432:0@lo:400:kworker.0 00000100:00100000:3.0:1787384803.767427:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384803.767448:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384803.767454:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787384803.767463:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203458304:0@lo:400:kworker.0 00000100:00100000:0.0:1787384803.767490:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203458688 00000100:00100000:3.0:1787384803.767497:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384803.767499:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203458688 00000100:00100000:3.0:1787384803.767528:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203458944:0@lo:400:kworker.0 00000100:00100000:0.0:1787384803.767547:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384803.767558:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203458688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384803.767566:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384803.767595:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203458816 00000100:00100000:3.0:1787384803.767599:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203458816 00000100:00100000:0.0:1787384803.767612:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203458688:12345-0@lo:400:kworker.0 Request processed in 54us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384803.767619:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787384803.767626:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203458432 00000100:00100000:3.0:1787384803.767630:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203458432 00000100:00100000:0.0:1787384803.767638:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203458944 00000100:00100000:0.0:1787384803.767643:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203458944 00000100:00100000:3.0:1787384803.767651:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787384803.767661:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203458816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384803.767667:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787384803.767677:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203458944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384803.767710:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203458816:12345-0@lo:400:kworker.0 Request processed in 51us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384803.767718:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203458944:12345-0@lo:400:kworker.0 Request processed in 42us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384803.767720:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787384803.767730:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384803.767744:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787384803.767752:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1874208203458432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384803.767757:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203458560:0@lo:8:kworker.0 00000100:00100000:3.0:1787384803.767864:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1874208203458432:12345-0@lo:400:kworker.0 Request processed in 112us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384803.768307:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203458304 00000100:00100000:2.0:1787384803.768313:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203458304 00000100:00100000:2.0:1787384803.768345:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787384803.768351:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:3651:x1874208203458304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384803.768386:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:3651:x1874208203458304:12345-0@lo:400:kworker.0 Request processed in 36us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384803.768392:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787384803.768393:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787384803.768445:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203458304:0@lo:400:kworker.0 00010000:00080000:3.0:1787384803.768461:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f4a47800 x1874208203458944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384803.768472:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203458944:0@lo:400:kworker.0 00000100:00100000:3.0:1787384803.768483:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203458816:0@lo:400:kworker.0 00000400:00000100:0.0:1787384803.770333:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203458560 offset 0 length 520: 4 00000100:00100000:0.0:1787384803.770416:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203458432:0@lo:400:kworker.0 00010000:00080000:0.0:1787384803.770432:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f4a46d80 x1874208203458688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384803.770442:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203458688:0@lo:400:kworker.0 00000001:00100000:3.0:1787384803.770671:0:23445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787384804.219852:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787384804.727467:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787384805.244098:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384806.265450:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384807.286876:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384807.864545:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203459072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384807.864628:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384807.864693:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203459072 00000100:00100000:1.0:1787384807.864701:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203459072 00000100:00100000:1.0:1787384807.864750:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384807.864758:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203459072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384807.864833:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787384807.864882:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203459072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384807.864890:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384807.864949:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203459072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384807.875754:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384807.876273:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203459200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384807.876360:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384807.876427:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203459200 00000100:00100000:1.0:1787384807.876436:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203459200 00000100:00100000:1.0:1787384807.876689:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384807.876700:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203459200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384807.876736:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384807.876817:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203459200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384807.876824:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384807.881369:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203459200:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787384808.313704:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787384808.492753:0:24214:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787384808.492757:0:24214:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787384808.492759:0:24214:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787384808.494687:0:24214:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98f8d9149000 00000020:01000004:0.0:1787384808.494706:0:24214:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787384808.494720:0:24214:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787384808.494734:0:24214:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98f8fc2b19c0) 00000020:00000080:0.0:1787384808.494752:0:24214:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787384808.584630:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787384808.585667:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787384808.586327:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787384808.586567:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787384808.586859:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787384808.587290:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787384808.588520:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1787384808.591766:0:24214:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787384808.592153:0:24214:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787384808.592166:0:24214:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787384808.592179:0:24214:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7ef423838fba442b 00000020:01000004:2.0:1787384808.592185:0:24214:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787384808.592209:0:24214:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787384808.592212:0:24214:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787384808.592219:0:24214:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787384808.592223:0:24214:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787384808.592449:0:24214:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98f8f54b0000) 00000020:00000080:2.0:1787384808.592470:0:24214:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787384808.593815:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384808.593969:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787384808.593977:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787384808.601999:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787384808.602012:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787384808.607240:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787384808.607252:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787384808.608912:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384808.609354:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787384808.609370:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787384808.610007:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787384808.610083:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787384808.641538:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384808.641767:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787384808.641773:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787384808.643453:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787384808.643465:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787384808.645996:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787384808.646133:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787384808.648540:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384808.648717:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787384808.648723:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787384808.650194:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787384808.650206:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787384808.696831:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384808.697457:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787384808.697464:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787384808.699115:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787384808.699129:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787384808.699641:0:24214:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787384808.699672:0:24214:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787384808.699679:0:24214:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787384808.712679:0:24214:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787384808.712722:0:24214:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.145@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787384808.712728:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787384808.712730:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787384808.712731:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384808.712732:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384808.712734:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384808.712735:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384808.712737:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384808.712739:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384808.712740:0:24214:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787384808.712745:0:24214:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787384808.712747:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787384808.712748:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787384808.712750:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384808.712751:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384808.712752:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384808.712753:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384808.712754:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384808.712755:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384808.712756:0:24214:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787384808.713207:0:24214:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787384808.713288:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203459328:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787384808.713366:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384808.713414:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9b41300 going to sleep for 11 seconds 00000100:00100000:2.0:1787384808.713489:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203459328 00000100:00100000:2.0:1787384808.713497:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203459328 00000100:00100000:2.0:1787384808.713586:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787384808.713596:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+18:24214:x1874208203459328:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787384808.713626:0:22706:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787384808.713630:0:22706:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787384808.713634:0:22706:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787384808.713949:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+18:24214:x1874208203459328:12345-0@lo:253:mount.lustre.0 Request processed in 353us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384808.713957:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787384808.714056:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203459328:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787384808.714067:0:24214:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787384808.714080:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787384808.714081:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787384808.714083:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384808.714084:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384808.714085:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384808.714085:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384808.714087:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384808.714088:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384808.714089:0:24214:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787384808.714121:0:24214:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f8d9149000 from lustre-OST0000 10000000:01000000:0.0:1787384808.714148:0:24214:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787384808.714151:0:24214:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787384808.714159:0:24214:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f7c2898000 local copy 00010000:00010000:0.0:1787384808.714169:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384808.714273:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203459456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384808.714305:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384808.714733:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8cadf8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384808.714902:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203459456 00000100:00100000:3.0:1787384808.714908:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203459456 00000100:00100000:3.0:1787384808.714941:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787384808.714948:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:24214:x1874208203459456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384808.715142:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:24214:x1874208203459456:12345-0@lo:501:mount.lustre.0 Request processed in 193us (835us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384808.715150:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787384808.715218:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203459456:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787384808.715245:0:24214:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787384808.715264:0:24214:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787384808.715270:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.715280:0:24214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384808.715305:0:24214:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f8d9149000 10000000:01000000:0.0:1787384808.715310:0:24214:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787384808.715316:0:24214:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787384808.715327:0:24214:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787384808.715332:0:24214:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787384808.715335:0:24214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787384808.715359:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05600/0x7ef423838fba4439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.715368:0:24214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05600/0x7ef423838fba4439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.715376:0:24214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05600/0x7ef423838fba4439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384808.715392:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203459584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787384808.715423:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384808.715450:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8cadf8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384808.715550:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203459584 00000100:00100000:3.0:1787384808.715555:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203459584 00000100:00100000:3.0:1787384808.715574:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787384808.715580:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+18:24214:x1874208203459584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384808.715588:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384808.715599:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cd600/0x7ef423838fba4440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba4439 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384808.715619:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cd600/0x7ef423838fba4440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba4439 expref: 19 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384808.715630:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cd600/0x7ef423838fba4440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4439 expref: 19 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384808.715639:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd600, rc 0) 00000100:00100000:3.0:1787384808.715681:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+19:24214:x1874208203459584:12345-0@lo:101:mount.lustre.0 Request processed in 100us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384808.715687:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787384808.715752:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203459584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384808.715763:0:24214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05600/0x7ef423838fba4439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba4440 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.715772:0:24214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05600/0x7ef423838fba4439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba4440 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384808.716769:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1787384808.717522:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384808.724416:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1787384808.724474:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1787384808.724490:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1787384808.724503:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1787384808.724517:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1787384808.724530:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1787384808.724556:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1787384808.724571:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1787384808.724584:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1787384808.724598:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1787384808.724611:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1787384808.724625:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1787384808.724652:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1787384808.724658:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1787384808.724770:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203459712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384808.724859:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384808.724906:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9b41300 going to sleep for 11 seconds 00000100:00100000:3.0:1787384808.725061:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203459712 00000100:00100000:3.0:1787384808.725069:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203459712 00000100:00100000:3.0:1787384808.725124:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787384808.725135:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+19:24214:x1874208203459712:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384808.725284:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+19:24214:x1874208203459712:12345-0@lo:501:mount.lustre.0 Request processed in 151us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384808.725292:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787384808.725485:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203459712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384808.725522:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203459840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384808.725565:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384808.725632:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9b41300 going to sleep for 11 seconds 00000100:00100000:1.0:1787384808.725879:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203459840 00000100:00100000:1.0:1787384808.725885:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203459840 00000100:00100000:3.0:1787384808.729299:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787384808.729325:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+19:24214:x1874208203459840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384808.730540:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+19:24214:x1874208203459840:12345-0@lo:503:mount.lustre.0 Request processed in 1224us (4969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384808.730552:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787384808.730655:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203459840:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787384808.731156:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384808.731253:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203459968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384808.731301:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384808.731328:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d00c26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384808.731626:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203459968 00000100:00100000:3.0:1787384808.731633:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203459968 00000100:00100000:3.0:1787384808.731664:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787384808.731672:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+19:24214:x1874208203459968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384808.732111:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+19:24214:x1874208203459968:12345-0@lo:502:mount.lustre.0 Request processed in 427us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384808.732119:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787384808.732428:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203459968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787384808.732648:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787384808.732693:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787384808.732710:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787384808.732725:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787384808.732739:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787384808.732754:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787384808.732766:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787384808.732800:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787384808.732817:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1787384808.732830:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1787384808.732843:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1787384808.732856:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1787384808.732889:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460096:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384808.732941:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384808.732967:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8cadf8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384808.733458:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203460096 00000100:00100000:3.0:1787384808.733466:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203460096 00000100:00100000:3.0:1787384808.733499:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787384808.733507:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+19:24214:x1874208203460096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384808.733621:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+19:24214:x1874208203460096:12345-0@lo:502:mount.lustre.0 Request processed in 113us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384808.733628:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787384808.733716:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787384808.733769:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1787384808.733816:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787384808.734761:0:24231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787384808.734770:0:24231:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787384808.734810:0:24231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384808.734813:0:24231:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787384808.734821:0:24231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787384808.734836:0:24231:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98f8f54b3380) 00000020:00000080:2.0:1787384808.734857:0:24231:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787384808.734864:0:24231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787384808.734948:0:24231:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8d9149000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787384808.734957:0:24231:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787384808.734963:0:24231:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7ef423838fba444e 00010000:00010000:2.0:1787384808.745097:0:24231:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787384808.745568:0:24231:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1787384808.747517:0:24231:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1787384808.754855:0:24231:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787384808.754868:0:24231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384808.754874:0:24231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384808.754876:0:24231:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787384808.754880:0:24231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787384808.754883:0:24231:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1787384808.754884:0:24231:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787384808.754886:0:24231:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787384808.754888:0:24231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787384808.754890:0:24231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384808.754891:0:24231:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787384808.754894:0:24231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384808.754897:0:24231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384808.754898:0:24231:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787384808.754901:0:24231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787384808.754903:0:24231:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787384808.754906:0:24231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384808.754909:0:24231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384808.754910:0:24231:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787384808.754912:0:24231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384808.754915:0:24231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384808.754916:0:24231:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787384808.757012:0:24231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787384808.757314:0:24231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384808.757320:0:24231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384808.757322:0:24231:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787384808.757327:0:24231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1787384808.759303:0:24214:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787384808.759344:0:24214:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787384808.759367:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05600/0x7ef423838fba4439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba4440 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384808.759380:0:24214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05600/0x7ef423838fba4439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba4440 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384808.759389:0:24214:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8d9149000 from 1 10000000:01000000:3.0:1787384808.759392:0:24214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384808.759429:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384808.759438:0:24214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384808.759450:0:24214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384808.759476:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384808.759546:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384808.759581:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7027d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384808.760026:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203460224 00000100:00100000:2.0:1787384808.760041:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203460224 00000100:00100000:2.0:1787384808.760080:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787384808.760088:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+19:24214:x1874208203460224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384808.760113:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384808.760126:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091200/0x7ef423838fba445c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba4455 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384808.760149:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091200/0x7ef423838fba445c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba4455 expref: 20 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384808.760160:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091200/0x7ef423838fba445c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4455 expref: 20 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384808.760169:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091200, rc 0) 00000100:00100000:2.0:1787384808.760213:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+20:24214:x1874208203460224:12345-0@lo:101:mount.lustre.0 Request processed in 125us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384808.760333:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787384808.760935:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384808.760953:0:24214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba445c expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384808.760975:0:24214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba445c expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384808.762993:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787384808.766092:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384808.766450:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787384808.766474:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787384808.766486:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787384808.766497:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787384808.766507:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787384808.766518:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787384808.766529:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787384808.766550:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787384808.766562:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787384808.766573:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787384808.766584:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787384808.766598:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787384808.766603:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787384808.766681:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384808.766740:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384808.766804:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7027900 going to sleep for 11 seconds 00000100:00100000:0.0:1787384808.767367:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203460352 00000100:00100000:0.0:1787384808.767375:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203460352 00000100:00100000:0.0:1787384808.767420:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787384808.767428:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+20:24214:x1874208203460352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384808.769471:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+20:24214:x1874208203460352:12345-0@lo:501:mount.lustre.0 Request processed in 2037us (2723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384808.769484:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787384808.772378:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384808.778343:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384808.778442:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384808.779265:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9b41d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384808.781537:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203460480 00000100:00100000:1.0:1787384808.781552:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203460480 00000100:00100000:1.0:1787384808.781608:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787384808.781618:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+20:24214:x1874208203460480:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384808.781806:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+20:24214:x1874208203460480:12345-0@lo:503:mount.lustre.0 Request processed in 189us (3364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384808.781815:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787384808.782488:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460480:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787384808.783365:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787384808.783462:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460608:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384808.783529:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384808.783569:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787384808.783657:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203460608 00000100:00100000:3.0:1787384808.783663:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203460608 00000100:00100000:3.0:1787384808.783707:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787384808.783715:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+20:24214:x1874208203460608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384808.783896:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+20:24214:x1874208203460608:12345-0@lo:502:mount.lustre.0 Request processed in 180us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384808.783904:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787384808.784400:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460608:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384808.784588:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1787384808.784619:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1787384808.784635:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1787384808.784648:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1787384808.784660:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1787384808.784673:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1787384808.784685:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1787384808.784697:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1787384808.784711:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1787384808.784722:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1787384808.784734:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1787384808.784773:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384808.785350:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384808.785387:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9b41d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384808.785534:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203460736 00000100:00100000:3.0:1787384808.785541:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203460736 00000100:00100000:3.0:1787384808.785586:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787384808.785594:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+20:24214:x1874208203460736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384808.785692:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+20:24214:x1874208203460736:12345-0@lo:502:mount.lustre.0 Request processed in 98us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384808.785699:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787384808.785955:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384808.786292:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1787384808.786306:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787384808.787611:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384808.787623:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384808.787625:0:24235:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787384808.787633:0:24235:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8d9149000 00000020:00000080:0.0:1787384808.787636:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787384808.787644:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384808.787647:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384808.787649:0:24235:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787384808.787662:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384808.787665:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384808.787667:0:24235:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787384808.787670:0:24235:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8d9149000 00000020:00000080:0.0:1787384808.787673:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787384808.787725:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384808.787729:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384808.787730:0:24235:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787384808.787733:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384808.787736:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384808.787737:0:24235:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787384808.787740:0:24235:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8d9149000 00000020:00000080:0.0:1787384808.787742:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787384808.787761:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384808.787764:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384808.787765:0:24235:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787384808.787768:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384808.787770:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384808.787772:0:24235:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787384808.787801:0:24235:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8d9149000 00000020:00000080:0.0:1787384808.787805:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787384808.787831:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384808.787834:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384808.787836:0:24235:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787384808.787839:0:24235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787384808.789442:0:24214:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787384808.789481:0:24214:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787384808.789504:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba445c expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384808.789516:0:24214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba445c expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384808.789573:0:24214:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787384808.789577:0:24214:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f8d9149000 10000000:01000000:1.0:1787384808.789580:0:24214:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f8d9149000 10000000:01000000:1.0:1787384808.789584:0:24214:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787384808.789589:0:24214:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8d9149000 from 1 10000000:01000000:1.0:1787384808.789591:0:24214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787384808.789625:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965bc00/0x7ef423838fba4463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384808.789634:0:24214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8d965bc00/0x7ef423838fba4463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384808.789644:0:24214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8d965bc00/0x7ef423838fba4463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384808.789681:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787384808.789748:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384808.791153:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c39480c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384808.809059:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203460864 00000100:00100000:2.0:1787384808.809076:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203460864 00000100:00100000:2.0:1787384808.809161:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787384808.809171:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+20:24214:x1874208203460864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384808.809188:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384808.809205:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091a00/0x7ef423838fba446a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba4463 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384808.809349:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091a00/0x7ef423838fba446a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba4463 expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384808.809362:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091a00/0x7ef423838fba446a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4463 expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384808.809384:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091a00, rc 0) 00000100:00100000:2.0:1787384808.809459:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+21:24214:x1874208203460864:12345-0@lo:101:mount.lustre.0 Request processed in 288us (19709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384808.809467:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787384808.811068:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384808.811092:0:24214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8d965bc00/0x7ef423838fba4463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba446a expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384808.811114:0:24214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8d965bc00/0x7ef423838fba4463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba446a expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384808.820882:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1787384808.821251:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384808.821455:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1787384808.821479:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1787384808.821491:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1787384808.821503:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1787384808.821516:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1787384808.821529:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1787384808.821541:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1787384808.821555:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1787384808.821568:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1787384808.821597:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1787384808.821613:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1787384808.821624:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1787384808.821635:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1787384808.821647:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1787384808.821659:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1787384808.821671:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1787384808.821683:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1787384808.821695:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1787384808.821706:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1787384808.821720:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1787384808.821732:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1787384808.821744:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1787384808.821772:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1787384808.821814:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1787384808.821829:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1787384808.821856:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1787384808.821872:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1787384808.821885:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1787384808.821896:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1787384808.821907:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1787384808.821917:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1787384808.821928:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1787384808.821938:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1787384808.821951:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1787384808.821964:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1787384808.821977:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1787384808.821990:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1787384808.822004:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1787384808.822017:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1787384808.822030:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1787384808.822045:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1787384808.822071:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1787384808.822088:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1787384808.822112:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1787384808.822129:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1787384808.822142:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1787384808.822155:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1787384808.822167:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1787384808.822287:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1787384808.822307:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1787384808.822326:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1787384808.822331:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1787384808.822449:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384808.822513:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384808.822569:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384808.825234:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203460992 00000100:00100000:1.0:1787384808.825247:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203460992 00000100:00100000:1.0:1787384808.825305:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787384808.825316:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:24214:x1874208203460992:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384808.825481:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:24214:x1874208203460992:12345-0@lo:501:mount.lustre.0 Request processed in 166us (2967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384808.825489:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787384808.826229:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203460992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384808.826283:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203461120:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384808.826338:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384808.826370:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384808.826388:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203461120 00000100:00100000:3.0:1787384808.826392:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203461120 00000100:00100000:3.0:1787384808.826424:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787384808.826432:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+21:24214:x1874208203461120:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384808.826516:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+21:24214:x1874208203461120:12345-0@lo:503:mount.lustre.0 Request processed in 84us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384808.826522:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787384808.826568:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203461120:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787384808.826999:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384808.827756:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203461248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384808.827837:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384808.827859:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384808.827881:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203461248 00000100:00100000:3.0:1787384808.827886:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203461248 00000100:00100000:3.0:1787384808.827916:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787384808.829328:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+21:24214:x1874208203461248:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384808.829487:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+21:24214:x1874208203461248:12345-0@lo:502:mount.lustre.0 Request processed in 172us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384808.829496:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787384808.829629:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203461248:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384808.829864:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787384808.829896:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787384808.829913:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787384808.829944:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787384808.829961:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787384808.829975:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787384808.829987:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787384808.830001:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787384808.830186:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787384808.830210:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787384808.830233:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787384808.830247:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787384808.830259:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787384808.830272:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787384808.830285:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787384808.830297:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787384808.830309:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787384808.830322:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787384808.830334:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787384808.830347:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787384808.830360:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787384808.830391:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787384808.830406:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787384808.830419:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787384808.830442:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1787384808.830456:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1787384808.830470:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1787384808.830481:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1787384808.830492:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1787384808.830504:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1787384808.830516:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1787384808.830528:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1787384808.830542:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1787384808.830555:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1787384808.830568:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1787384808.830583:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1787384808.830596:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1787384808.830623:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1787384808.830641:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1787384808.830655:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1787384808.830670:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1787384808.830684:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1787384808.830697:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1787384808.830711:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1787384808.830723:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1787384808.830734:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1787384808.830746:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1787384808.830761:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1787384808.830831:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203461376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384808.830891:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384808.832152:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203461376 00000100:00100000:3.0:1787384808.832161:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203461376 00000100:00100000:3.0:1787384808.842853:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787384808.842878:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:24214:x1874208203461376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384808.844221:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:24214:x1874208203461376:12345-0@lo:502:mount.lustre.0 Request processed in 1347us (13324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384808.844302:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787384808.846501:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41310c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384808.846542:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203461376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384808.846759:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787384808.846818:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787384808.846857:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203461504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384808.846928:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384808.846959:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41310c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384808.852436:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203461504 00000100:00100000:3.0:1787384808.852452:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203461504 00000100:00100000:3.0:1787384808.852518:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787384808.852528:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+21:24214:x1874208203461504:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384808.852703:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+21:24214:x1874208203461504:12345-0@lo:502:mount.lustre.0 Request processed in 176us (5774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384808.852710:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787384808.853424:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203461504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384808.853510:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787384808.853523:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787384808.854603:0:24240:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787384808.854617:0:24240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98f8f54b19c0) 00000020:00000080:2.0:1787384808.854640:0:24240:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787384808.854828:0:24240:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8d9149000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787384808.854833:0:24240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8d9149000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787384808.854835:0:24240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8d9149000 3 00010000:00080000:2.0:1787384808.854862:0:24240:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8ee315000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.145@tcp at head 00010000:00010000:2.0:1787384808.863871:0:24240:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1787384808.867320:0:24240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787384808.867384:0:24240:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787384808.867399:0:24240:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7ef423838fba4478 00000100:00080000:2.0:1787384808.867409:0:24240:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787384808.867416:0:24240:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f8ee315000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384808.867453:0:24240:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f0ff0a80 x1874208203461632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787384808.867498:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203461632:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787384808.867566:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787384808.867628:0:24240:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787384808.869483:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384808.869490:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384808.869492:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384808.869495:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384808.869521:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384808.869525:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384808.869535:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384808.869538:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787384808.869642:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203462016:0@lo:400:kworker.0 00000100:00100000:1.0:1787384808.869705:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384808.869737:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384808.869744:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203462144:0@lo:400:kworker.0 00000100:00100000:1.0:1787384808.869769:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384808.869825:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203462016 00000100:00100000:1.0:1787384808.869832:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203462016 00000100:00100000:1.0:1787384808.869873:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787384808.869882:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203462016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384808.869939:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203462016:12345-0@lo:400:kworker.0 Request processed in 58us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384808.869947:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787384808.869973:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203461632 00000100:00100000:1.0:1787384808.869978:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203461632 00000100:00100000:1.0:1787384808.869993:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203462144 00000100:00100000:1.0:1787384808.869995:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203462144 00000100:00100000:1.0:1787384808.870009:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787384808.870014:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203462144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384808.870041:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203462144:12345-0@lo:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384808.870047:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787384808.870060:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384808.870064:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874208203461632:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787384808.870084:0:22712:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:1.0:1787384808.870156:0:22712:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7ef423838fba447f 00000004:00100000:1.0:1787384808.870171:0:22712:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787384808.870204:0:22712:0:(import.c:65:import_set_state_nolock()) ffff98f8f919c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384808.871993:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874208203461632:12345-0@lo:38:llog_process_th.0 Request processed in 1918us (4417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384808.872005:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787384808.872181:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f7c2a00380 x1874208203462144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384808.872197:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203462144:0@lo:400:kworker.0 00000100:00100000:1.0:1787384808.872211:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203462016:0@lo:400:kworker.0 00000100:00100000:3.0:1787384808.872442:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203461760:0@lo:400:kworker.0 00000100:00100000:3.0:1787384808.872486:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384808.872520:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384808.872527:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203461888:0@lo:400:kworker.0 00000100:00100000:3.0:1787384808.872547:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384808.872610:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203461760 00000100:00100000:1.0:1787384808.872617:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203461760 00000100:00100000:1.0:1787384808.872651:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787384808.872659:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203461760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384808.872706:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203461760:12345-0@lo:400:kworker.0 Request processed in 47us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384808.872713:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787384808.873007:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203461760:0@lo:400:kworker.0 00010000:00080000:2.0:1787384808.873164:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f0ff0a80 x1874208203461632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384808.873173:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384808.873182:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787384808.873204:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787384808.873210:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787384808.873214:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8ee315000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787384808.873222:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203461632:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1787384808.873344:0:24240:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787384808.873359:0:24240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98f8f54b4d40) 00000020:00000080:2.0:1787384808.873381:0:24240:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1787384808.873568:0:24240:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8d9149000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787384808.873573:0:24240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8d9149000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787384808.873576:0:24240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8d9149000 3 00010000:00080000:2.0:1787384808.873605:0:24240:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8fde26000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.145@tcp at head 00010000:00010000:2.0:1787384808.875338:0:24240:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787384808.875449:0:24240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787384808.875491:0:24240:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787384808.875504:0:24240:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x7ef423838fba448d 00000100:00080000:2.0:1787384808.875513:0:24240:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787384808.875518:0:24240:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98f8fde26000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384808.875553:0:24240:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f0ff0a80 x1874208203462272/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787384808.875599:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874208203462272:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787384808.875662:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384808.881863:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203461888 00000100:00100000:0.0:1787384808.881876:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203461888 00000100:00100000:0.0:1787384808.881951:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203462272 00000100:00100000:0.0:1787384808.881955:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203462272 00000100:00100000:0.0:1787384808.881974:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384808.881983:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203461888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384808.882652:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203461888:12345-0@lo:400:kworker.0 Request processed in 666us (10100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384808.882671:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384808.882699:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384808.882706:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874208203462272:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787384808.882735:0:22713:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:0.0:1787384808.882774:0:22713:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x7ef423838fba4494 00000004:00100000:0.0:1787384808.882820:0:22713:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787384808.882862:0:22713:0:(import.c:65:import_set_state_nolock()) ffff98f7c2894800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384808.882908:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874208203462272:12345-0@lo:38:llog_process_th.0 Request processed in 202us (7246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384808.883095:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787384808.883168:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f0ff0a80 x1874208203462272/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384808.883180:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787384808.883189:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1787384808.883198:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787384808.883203:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787384808.883205:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8fde26000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787384808.883211:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874208203462272:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787384808.883465:0:24240:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787384808.883492:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384808.883497:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384808.883499:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384808.883502:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384808.883512:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384808.883515:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384808.883518:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384808.883520:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787384808.883699:0:24240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00010000:00080000:3.0:1787384808.884941:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f7c2a01f80 x1874208203461888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384808.884956:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203461888:0@lo:400:kworker.0 00000020:01000000:2.0:1787384808.886427:0:24214:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787384808.886468:0:24214:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787384808.886484:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965bc00/0x7ef423838fba4463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba446a expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384808.886497:0:24214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8d965bc00/0x7ef423838fba4463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba446a expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787384808.886546:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787384808.886548:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787384808.886549:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384808.886551:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787384808.886552:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384808.886553:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384808.886555:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787384808.886556:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384808.886558:0:24214:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787384808.886561:0:24214:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787384808.886563:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787384808.886565:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787384808.886566:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384808.886567:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787384808.886568:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384808.886569:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384808.886569:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787384808.886570:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384808.886571:0:24214:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787384808.886593:0:24214:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787384808.886613:0:24214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203462400:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787384808.886668:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384808.886704:0:24214:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c4131a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384808.887316:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203462400 00000100:00100000:2.0:1787384808.887323:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203462400 00000100:00100000:2.0:1787384808.887364:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787384808.887371:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+21:24214:x1874208203462400:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787384808.887395:0:22707:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787384808.887407:0:22707:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787384808.893979:0:22707:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787384808.893995:0:22707:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787384808.894096:0:22729:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787384808.894111:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787384808.894134:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894152:0:22729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba43e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba43de expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894172:0:22729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8d965a600/0x7ef423838fba43f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba43ec expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894180:0:22729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894218:0:22729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8d965a600/0x7ef423838fba43f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba43ec expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894244:0:22729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8d965a600/0x7ef423838fba43f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba43ec expref: 21 pid: 22706 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384808.894260:0:22729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203462528:0@lo:104: 00000100:00100000:0.0:1787384808.894322:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384808.894370:0:22729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba43e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba43de expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894378:0:22729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba43e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba43de expref: 21 pid: 22707 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384808.894387:0:22729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203462656:0@lo:104: 00000100:00100000:0.0:1787384808.894411:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384808.894428:0:22729:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8cadf8600 going to sleep for 11 seconds 00000100:00100000:0.0:1787384808.894452:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787384808.894469:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203462528 00000100:00100000:0.0:1787384808.894475:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203462528 00000100:00100000:0.0:1787384808.894506:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203462656 00000100:00100000:0.0:1787384808.894509:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203462656 00000100:00100000:0.0:1787384808.894523:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384808.894536:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+4:22729:x1874208203462528:12345-0@lo:104: 00010000:00010000:0.0:1787384808.894548:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba43f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894594:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384808.894600:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+4:22729:x1874208203462528:12345-0@lo:104: Request processed in 64us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384808.894607:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384808.894624:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384808.894630:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8eef98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+3:22729:x1874208203462656:12345-0@lo:104: 00010000:00010000:0.0:1787384808.894636:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba43e5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894666:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787384808.894670:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8eef98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+3:22729:x1874208203462656:12345-0@lo:104: Request processed in 41us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384808.894676:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787384808.894711:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384808.894717:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba43f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894725:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158400 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384808.894728:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba43f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894736:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba43f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384808.894743:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba43f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384808.894756:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384808.894806:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba43f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894812:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384808.894832:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba43f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894839:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba43ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba43f3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894851:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384808.894854:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba43e5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894860:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902159a00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384808.894863:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba43e5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894869:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba43e5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384808.894875:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba43e5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384808.894880:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384808.894894:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba43e5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894899:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384808.894914:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba43e5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894919:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902159a00/0x7ef423838fba43de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba43e5 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.894932:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384808.894934:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384808.894936:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384808.894942:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384808.894962:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203462912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384808.894992:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384808.895081:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384808.895090:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203462784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384808.895129:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384808.895161:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203462912 00000100:00100000:0.0:1787384808.895165:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203462912 00010000:00010000:0.0:1787384808.895183:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba43e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba43de expref: 22 pid: 22707 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384808.895203:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203462784 00000100:00100000:0.0:1787384808.895206:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203462784 00010000:00010000:0.0:1787384808.895216:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8d965a600/0x7ef423838fba43f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba43ec expref: 23 pid: 22706 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384808.895227:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384808.895232:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a654d8f2-2ab4-4025-870e-e3edf79de730+23:3652:x1874208203462912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384808.895241:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384808.895246:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba43e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba43de expref: 23 pid: 22707 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895266:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba43e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba43de expref: 23 pid: 22707 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895283:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384808.895314:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a654d8f2-2ab4-4025-870e-e3edf79de730+23:3652:x1874208203462912:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384808.895322:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384808.895336:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384808.895341:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c405dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a654d8f2-2ab4-4025-870e-e3edf79de730+22:3652:x1874208203462784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384808.895349:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384808.895353:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8d965a600/0x7ef423838fba43f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba43ec expref: 22 pid: 22706 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895362:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8d965a600/0x7ef423838fba43f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba43ec expref: 22 pid: 22706 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895373:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895381:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787384808.895392:0:22699:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005319371s 00010000:00010000:0.0:1787384808.895397:0:22699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895403:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895418:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895424:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895429:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384808.895434:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895441:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895450:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895458:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384808.895480:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c405dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a654d8f2-2ab4-4025-870e-e3edf79de730+22:3652:x1874208203462784:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384808.895486:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384808.895541:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203462784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384808.895550:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203462912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384808.895575:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8d965a600/0x7ef423838fba43f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba43ec expref: 21 pid: 22706 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384808.895584:0:22729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203462528:0@lo:104: 00010000:00010000:0.0:1787384808.895591:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba43e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba43de expref: 20 pid: 22707 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384808.895604:0:22729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203462656:0@lo:104: 00010000:00010000:0.0:1787384808.895616:0:22729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895623:0:22729:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895629:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384808.895634:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba449b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384808.896306:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+19:24214:x1874208203462400:12345-0@lo:253:mount.lustre.0 Request processed in 8932us (9634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384808.896317:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787384808.896376:0:24214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:24214:1874208203462400:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787384808.896387:0:24214:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787384808.896397:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384808.896399:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787384808.896400:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384808.896401:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384808.896402:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384808.896403:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384808.896405:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384808.896407:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384808.896408:0:24214:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787384808.896448:0:24214:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1787384808.898345:0:24214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787384808.901462:0:24214:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787384808.901473:0:24214:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787384808.901520:0:24214:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787384808.901563:0:24214:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787384808.901584:0:24214:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787384808.901601:0:24214:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787384808.902624:0:24214:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384808.902864:0:24214:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787384809.341027:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787384810.077492:0:24293:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384810.077733:0:24293:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787384810.359883:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787384810.871506:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787384810.937795:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787384810.937803:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8efb5a800 from 13 10000000:01000000:2.0:1787384810.937808:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787384810.937854:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.937867:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.937878:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384810.937906:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203463040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384810.937972:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384810.938009:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c4131600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384810.938038:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203463040 00000100:00100000:2.0:1787384810.938044:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203463040 00000100:00100000:2.0:1787384810.938109:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787384810.938118:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+19:22709:x1874208203463040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384810.938131:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384810.938143:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091c00/0x7ef423838fba44a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba44a2 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.938164:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091c00/0x7ef423838fba44a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba44a2 expref: 20 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.938174:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091c00/0x7ef423838fba44a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba44a2 expref: 20 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.938182:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091c00, rc 0) 00000100:00100000:2.0:1787384810.938217:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+20:22709:x1874208203463040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384810.938223:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787384810.938278:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203463040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384810.938294:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba44a9 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.938302:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba44a9 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384810.938345:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203463168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787384810.938373:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384810.938386:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6374540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384810.938396:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203463168 00000100:00100000:2.0:1787384810.938399:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203463168 00000100:00100000:2.0:1787384810.938424:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787384810.938430:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+20:22709:x1874208203463168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787384810.938442:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787384810.938457:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787384810.938460:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787384810.938524:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+20:22709:x1874208203463168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384810.938531:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787384810.938558:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203463168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787384810.938607:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787384810.938613:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba44a9 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.938621:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba44a9 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384810.938630:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787384810.938632:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f0fb9000 from 13 10000000:01000000:2.0:1787384810.938634:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787384810.938647:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.938654:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.938662:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384810.938673:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203463296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384810.938702:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384810.938714:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6374540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384810.938724:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203463296 00000100:00100000:2.0:1787384810.938728:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203463296 00000100:00100000:2.0:1787384810.938748:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787384810.938754:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+20:22709:x1874208203463296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384810.938761:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384810.938769:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba44b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba44b0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.938803:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba44b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba44b0 expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.938813:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba44b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba44b0 expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.938820:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090a00, rc 0) 00000100:00100000:2.0:1787384810.938846:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+21:22709:x1874208203463296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384810.938852:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787384810.938879:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203463296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384810.938888:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba44b7 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.938896:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba44b7 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384810.938930:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203463424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787384810.938957:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384810.938969:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6374540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384810.938979:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203463424 00000100:00100000:2.0:1787384810.938982:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203463424 00000100:00100000:2.0:1787384810.939001:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787384810.939007:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:22709:x1874208203463424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787384810.939016:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787384810.939027:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787384810.939029:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787384810.939095:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:22709:x1874208203463424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 78us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384810.939102:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787384810.939129:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203463424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787384810.939162:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787384810.939167:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba44b7 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384810.939175:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba44b7 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384811.386517:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384812.407212:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384812.992196:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203463552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384812.992512:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384812.992718:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203463552 00000100:00100000:1.0:1787384812.992727:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203463552 00000100:00100000:1.0:1787384812.992768:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787384812.992803:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203463552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384812.992836:0:22718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787384812.992883:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203463552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384812.992890:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787384812.992936:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203463552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384812.994374:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203463680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384812.994423:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384812.994498:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203463680 00000100:00100000:2.0:1787384812.994504:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203463680 00000100:00100000:2.0:1787384812.994650:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787384812.994659:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203463680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384812.994686:0:22718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787384812.994772:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203463680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384812.994810:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384812.998954:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203463680:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787384813.439063:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787384814.007508:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384814.007514:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384814.007516:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384814.007519:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384814.007544:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384814.007546:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384814.007549:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384814.007552:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787384814.007629:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203463808:0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.007710:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384814.007745:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203464320:0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.007803:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384814.007828:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787384814.007834:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203463936:0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.007896:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384814.007914:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203464448:0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.007935:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384814.007959:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203464064:0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.007981:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384814.007996:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203464576:0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.008016:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384814.008051:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384814.008058:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203464192:0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.008096:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384814.008128:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203463808 00000100:00100000:2.0:1787384814.008135:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203463808 00000100:00100000:2.0:1787384814.008179:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787384814.008187:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+21:3651:x1874208203463808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.008232:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+21:3651:x1874208203463808:12345-0@lo:400:kworker.0 Request processed in 45us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384814.008239:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787384814.008269:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203464320 00000100:00100000:2.0:1787384814.008273:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203464320 00000100:00100000:2.0:1787384814.008291:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203464448 00000100:00100000:2.0:1787384814.008293:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203464448 00000100:00100000:2.0:1787384814.008314:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203464064 00000100:00100000:2.0:1787384814.008316:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203464064 00000100:00100000:2.0:1787384814.008325:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203464576 00000100:00100000:2.0:1787384814.008327:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203464576 00000100:00100000:2.0:1787384814.008342:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384814.008348:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203464320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.008378:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203464320:12345-0@lo:400:kworker.0 Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384814.008384:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384814.008396:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384814.008402:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203464448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.008427:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203464448:12345-0@lo:400:kworker.0 Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384814.008432:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384814.008451:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384814.008456:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203464064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.008488:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203464064:12345-0@lo:400:kworker.0 Request processed in 32us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384814.008494:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384814.008504:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384814.008510:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203464576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.008535:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203464576:12345-0@lo:400:kworker.0 Request processed in 25us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384814.008541:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384814.008556:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203463936 00000100:00100000:2.0:1787384814.008559:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203463936 00000100:00100000:2.0:1787384814.008574:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203464192 00000100:00100000:2.0:1787384814.008576:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203464192 00000100:00100000:2.0:1787384814.008587:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787384814.008593:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203463936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.008623:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203463936:12345-0@lo:400:kworker.0 Request processed in 29us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384814.008628:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787384814.008639:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787384814.008644:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203464192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.008668:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203464192:12345-0@lo:400:kworker.0 Request processed in 25us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384814.008674:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787384814.008709:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384814.008712:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384814.008738:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203464192:0@lo:400:kworker.0 00010000:00080000:2.0:1787384814.008773:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f0ff1c00 x1874208203464064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384814.008803:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203464064:0@lo:400:kworker.0 00010000:00080000:2.0:1787384814.008814:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f91d8a80 x1874208203464576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384814.008822:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203464576:0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.008854:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203463936:0@lo:400:kworker.0 00010000:00080000:2.0:1787384814.008864:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f91d9180 x1874208203464448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384814.008872:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203464448:0@lo:400:kworker.0 00000100:00100000:2.0:1787384814.008879:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203463808:0@lo:400:kworker.0 00010000:00080000:2.0:1787384814.008886:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f0ff3800 x1874208203464320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384814.008893:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203464320:0@lo:400:kworker.0 00010000:00010000:0.0:1787384814.454917:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787384814.969409:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787384815.481011:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787384815.887394:0:24583:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787384816.506513:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787384817.057000:0:24636:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384817.057438:0:24636:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787384817.082277:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384802/real 1787384802] req@ffff98f8f0ff2a00 x1874208203457920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384817 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384817.082310:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f0ff2a00 x1874208203457920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384817 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384817.082343:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384802/real 1787384802] req@ffff98f8f0ff1f80 x1874208203458048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384817 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384817.082356:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f0ff1f80 x1874208203458048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384817 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384817.082382:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d41800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384817.082408:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787384817.082413:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203457920:0@lo:8:kworker.0 00000100:00080000:2.0:1787384817.082420:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384817.082426:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787384817.082429:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203458048:0@lo:8:kworker.0 00000100:00080000:0.0:1787384817.082561:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384817.082565:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384817.082568:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384817.082571:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384817.082586:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384817.082588:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787384817.082592:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d41800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384817.082597:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 697 00000100:00080000:0.0:1787384817.082603:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787384817.082611:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98f8f7d41800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384817.082639:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f4a44380 x1874208203465216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384817.082652:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384817.082654:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787384817.082656:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384817.082658:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 697 00000100:00080000:0.0:1787384817.082661:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787384817.082664:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f943d000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384817.082675:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f4a47800 x1874208203465344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384817.082713:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203465088:0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.082802:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384817.082832:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787384817.082839:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203464704:0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.082864:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384817.082887:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203465472:0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.082925:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384817.082948:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203464832:0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.082970:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384817.082986:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203465600:0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.083007:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384817.083021:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787384817.083026:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203464960:0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.083053:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384817.083078:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203465728:0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.083100:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384817.083123:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203465088 00000100:00100000:0.0:1787384817.083129:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203465088 00000100:00100000:0.0:1787384817.083160:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203464832 00000100:00100000:0.0:1787384817.083163:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203464832 00000100:00100000:0.0:1787384817.083309:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787384817.083316:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203465088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.083372:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203465088:12345-0@lo:400:kworker.0 Request processed in 55us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384817.083379:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787384817.083396:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787384817.083402:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203464832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.083433:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203464832:12345-0@lo:400:kworker.0 Request processed in 32us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384817.083438:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787384817.083456:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203464704 00000100:00100000:0.0:1787384817.083460:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203464704 00000100:00100000:0.0:1787384817.083485:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787384817.083490:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+21:3653:x1874208203464704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.083518:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+21:3653:x1874208203464704:12345-0@lo:400:kworker.0 Request processed in 28us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384817.083524:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787384817.083549:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203465472 00000100:00100000:0.0:1787384817.083552:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203465472 00000100:00100000:0.0:1787384817.083570:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203465600 00000100:00100000:0.0:1787384817.083572:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203465600 00000100:00100000:0.0:1787384817.083595:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203464960 00000100:00100000:0.0:1787384817.083604:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203464960 00000100:00100000:0.0:1787384817.083621:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203465728 00000100:00100000:0.0:1787384817.083624:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203465728 00000100:00100000:0.0:1787384817.083638:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787384817.083643:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203465472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.083672:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203465472:12345-0@lo:400:kworker.0 Request processed in 29us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384817.083678:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787384817.083690:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787384817.083696:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203465600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.083720:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203465600:12345-0@lo:400:kworker.0 Request processed in 24us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384817.083725:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787384817.083735:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787384817.083741:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203464960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.083766:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203464960:12345-0@lo:400:kworker.0 Request processed in 26us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384817.083772:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787384817.083809:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787384817.083815:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203465728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.083839:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203465728:12345-0@lo:400:kworker.0 Request processed in 25us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384817.083844:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787384817.083870:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384817.083873:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787384817.084335:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f4a46d80 x1874208203464960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384817.084361:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203464960:0@lo:400:kworker.0 00010000:00080000:0.0:1787384817.084378:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f4a46a00 x1874208203465728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384817.084385:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203465728:0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.084395:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203464832:0@lo:400:kworker.0 00010000:00080000:0.0:1787384817.084403:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f4a47100 x1874208203465600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384817.084411:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203465600:0@lo:400:kworker.0 00000100:00100000:0.0:1787384817.084446:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203465216:0@lo:8:kworker.0 00000100:00100000:0.0:1787384817.084480:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384817.085285:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203465344:0@lo:8:kworker.0 00000100:00100000:0.0:1787384817.085313:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384817.087386:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203464704:0@lo:400:kworker.0 00010000:00080000:3.0:1787384817.087406:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f4a44e00 x1874208203465472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384817.087418:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203465472:0@lo:400:kworker.0 00000100:00100000:3.0:1787384817.087430:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203465088:0@lo:400:kworker.0 00000100:00100000:2.0:1787384817.094134:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203465216 00000100:00100000:2.0:1787384817.094147:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203465216 00000100:00100000:3.0:1787384817.094282:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203465344 00000100:00100000:3.0:1787384817.094286:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203465344 00000100:00100000:3.0:1787384817.094318:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384817.094325:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203465216:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787384817.094366:0:24220:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 712 last 0 00000020:00000080:3.0:1787384817.094394:0:24220:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba44be 00002000:00100000:3.0:1787384817.094408:0:24220:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98f8f943b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787384817.094412:0:24220:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787384817.094414:0:24220:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787384817.094562:0:24220:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787384817.094586:0:24220:0:(import.c:65:import_set_state_nolock()) ffff98f8f9439800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384817.094662:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1874208203465216:12345-0@lo:8:kworker.0 Request processed in 335us (10180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384817.094669:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384817.094684:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384817.094688:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203465344:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787384817.094699:0:24220:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1787384817.096146:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f4a44380 x1874208203465216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384817.096158:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787384817.096166:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1787384817.096174:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787384817.096181:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787384817.096184:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d41800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787384817.096204:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787384817.096210:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203465216:0@lo:8:kworker.0 00000004:00080000:1.0:1787384817.096257:0:23455:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787384817.096278:0:23455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1874208203465984:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787384817.096328:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384817.096347:0:23455:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787384817.096362:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384817.096373:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203465856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384817.096415:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384817.096451:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203465856 00000100:00100000:1.0:1787384817.096456:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203465856 00000100:00100000:1.0:1787384817.096500:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384817.096508:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1874208203465856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384817.096530:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787384817.096565:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1874208203465856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384817.096572:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787384817.096600:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c2a02a00 x1874208203465856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384817.096613:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203465856:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787384817.096630:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384817.097156:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787384817.097166:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:0.0:1787384817.099137:0:23454:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787384817.099248:0:23454:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 712179468830ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787384817.099256:0:23454:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787384817.101793:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203465984 00000100:00100000:1.0:1787384817.101806:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203465984 00000100:00100000:0.0:1787384817.101978:0:24638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384817.101988:0:24638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23455:x1874208203465984:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1787384817.116718:0:24638:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787384817.116728:0:24638:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1787384817.116830:0:24638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23455:x1874208203465984:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14839us (20497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384817.116849:0:24638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:1.0:1787384817.116936:0:23445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:1.0:1787384817.116989:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c2a00000 x1874208203465984/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787384833 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384817.117004:0:23455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1874208203465984:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787384817.117016:0:23455:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1787384817.117181:0:23455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1874208203466112:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787384817.117217:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384817.117241:0:23455:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787384817.117261:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203466112 00000100:00100000:1.0:1787384817.117267:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203466112 00000100:00100000:1.0:1787384817.117304:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384817.117319:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23455:x1874208203466112:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787384817.117345:0:24218:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1787384817.117374:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23455:x1874208203466112:12345-0@lo:5:osp-pre-0-1.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384817.117380:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787384817.117407:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c2a00000 x1874208203466112/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384833 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384817.117416:0:23455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1874208203466112:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787384817.117424:0:23455:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1787384817.117445:0:23455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1874208203466240:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787384817.117464:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384817.117475:0:23455:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9780 going to sleep for 11 seconds 00000100:00100000:0.0:1787384817.117604:0:24638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203466240 00000100:00100000:0.0:1787384817.117608:0:24638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203466240 00000100:00100000:0.0:1787384817.117637:0:24638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384817.117644:0:24638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23455:x1874208203466240:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787384817.117666:0:24638:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1787384817.164812:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203465344:12345-0@lo:8:kworker.0 Request processed in 70085us (79461us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787384817.164827:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787384817.165097:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384817.165103:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787384817.165107:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203465344:0@lo:8:kworker.0 00000001:00080000:1.0:1787384817.166275:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1787384817.166287:0:24215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787384817.166439:0:24638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23455:x1874208203466240:12345-0@lo:5:osp-pre-0-1.0 Request processed in 48793us (48971us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787384817.166449:0:24638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787384817.166974:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c2a00000 x1874208203466240/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384833 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384817.166986:0:23455:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787384817.166991:0:23455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1874208203466240:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787384817.167006:0:23455:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1787384817.167063:0:23455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23455:1874208203466368:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787384817.167109:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384817.167434:0:23455:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787384817.171531:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203466368 00000100:00100000:1.0:1787384817.171544:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203466368 00000100:00100000:1.0:1787384817.171596:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384817.171605:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23455:x1874208203466368:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787384817.171703:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23455:x1874208203466368:12345-0@lo:900:osp-pre-0-1.0 Request processed in 99us (4593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384817.171711:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787384817.171808:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c2a00000 x1874208203466368/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787384833 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384817.171823:0:23455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23455:1874208203466368:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1787384817.527415:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787384818.036594:0:24687:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384818.037030:0:24687:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787384818.103149:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203466496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384818.103225:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384818.103269:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203466496 00000100:00100000:1.0:1787384818.103277:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203466496 00000100:00100000:1.0:1787384818.103320:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384818.103329:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203466496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384818.103358:0:22718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384818.103400:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203466496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384818.103406:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384818.103445:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203466496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384818.103557:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384818.103566:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203466624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384818.103592:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384818.103614:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203466624 00000100:00100000:2.0:1787384818.103617:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203466624 00000100:00100000:2.0:1787384818.103635:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787384818.103641:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203466624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384818.103657:0:22718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787384818.103700:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203466624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384818.103707:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787384818.103734:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203466624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787384818.554903:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384819.584897:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787384820.087818:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787384820.602547:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384821.625056:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787384822.199999:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384822.200016:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384822.200020:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384822.200023:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384822.200047:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384822.200050:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787384822.200055:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384822.200066:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 712 00000100:00080000:2.0:1787384822.200074:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787384822.200083:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f943d000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384822.200110:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f91d9500 x1874208203467392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787384822.200191:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203466752:0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.200293:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384822.200350:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203467264:0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.200382:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384822.200411:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787384822.200416:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203467136:0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.200459:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384822.200479:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203467776:0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.200505:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384822.200538:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203466880:0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.200563:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384822.200581:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203467520:0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.200599:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384822.200613:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787384822.200617:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203467008:0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.200633:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384822.200645:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203467648:0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.200661:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384822.200687:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384802/real 1787384802] req@ffff98f8f0ff1880 x1874208203457536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384822 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384822.200704:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f0ff1880 x1874208203457536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384822 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384822.200716:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203467392:0@lo:8:kworker.0 00000100:00100000:2.0:1787384822.200736:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787384822.200755:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c354a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384822.200767:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787384822.200771:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203457536:0@lo:8:kworker.0 00000100:00100000:2.0:1787384822.200839:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203466752 00000100:00100000:2.0:1787384822.200848:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203466752 00000100:00100000:2.0:1787384822.200901:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787384822.200918:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:3652:x1874208203466752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.200977:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:3652:x1874208203466752:12345-0@lo:400:kworker.0 Request processed in 59us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384822.200986:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787384822.201036:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203467264 00000100:00100000:2.0:1787384822.201041:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203467264 00000100:00100000:2.0:1787384822.201080:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203467392 00000100:00100000:2.0:1787384822.201083:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203467392 00000100:00100000:2.0:1787384822.201098:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384822.201104:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203467264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.201138:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203467264:12345-0@lo:400:kworker.0 Request processed in 34us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384822.201144:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384822.201156:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384822.201160:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874208203467392:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787384822.201183:0:24221:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787384822.201218:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874208203467392:12345-0@lo:8:kworker.0 Request processed in 56us (480us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787384822.201224:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384822.201244:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203467136 00000100:00100000:2.0:1787384822.201248:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203467136 00000100:00100000:2.0:1787384822.201266:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203466880 00000100:00100000:2.0:1787384822.201269:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203466880 00000100:00100000:2.0:1787384822.201280:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787384822.201285:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203467136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.201315:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203467136:12345-0@lo:400:kworker.0 Request processed in 30us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384822.201330:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787384822.201340:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787384822.201345:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203466880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.201374:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203466880:12345-0@lo:400:kworker.0 Request processed in 29us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384822.201379:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787384822.201401:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787384822.201430:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384822.201434:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787384822.201437:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203467392:0@lo:8:kworker.0 00000100:00100000:2.0:1787384822.201462:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203466880:0@lo:400:kworker.0 00000100:00080000:2.0:1787384822.201480:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384822.201484:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787384822.201486:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f7c354a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384822.201490:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 697 00000100:00080000:2.0:1787384822.201493:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787384822.201497:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f7c354a000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384822.201518:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f0ff1880 x1874208203467904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384822.201533:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384822.201537:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787384822.201552:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203467904:0@lo:8:kworker.0 00000100:00100000:2.0:1787384822.201576:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384822.201604:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203467904 00000100:00100000:2.0:1787384822.201607:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203467904 00000100:00100000:2.0:1787384822.201620:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384822.201624:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874208203467904:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787384822.201641:0:24221:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:2.0:1787384822.201672:0:24221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba44c5 00002000:00100000:2.0:1787384822.201688:0:24221:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98f8fde22000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787384822.201693:0:24221:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787384822.201695:0:24221:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787384822.201824:0:24221:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787384822.201849:0:24221:0:(import.c:65:import_set_state_nolock()) ffff98f8fde24800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384822.201889:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1874208203467904:12345-0@lo:8:kworker.0 Request processed in 263us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384822.201895:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787384822.201923:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f0ff1880 x1874208203467904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384822.201931:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384822.201937:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787384822.201945:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787384822.201951:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787384822.201953:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c354a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787384822.201975:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787384822.201980:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203467904:0@lo:8:kworker.0 00000100:00100000:2.0:1787384822.202018:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203467136:0@lo:400:kworker.0 00000100:00100000:2.0:1787384822.202029:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203466752:0@lo:400:kworker.0 00010000:00080000:2.0:1787384822.202039:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f91d8380 x1874208203467264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384822.202056:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203467264:0@lo:400:kworker.0 00000100:00100000:0.0:1787384822.203176:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203467776 00000100:00100000:0.0:1787384822.203189:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203467776 00000100:00100000:0.0:1787384822.203257:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203467520 00000100:00100000:0.0:1787384822.203261:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203467520 00000100:00100000:0.0:1787384822.203276:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203467008 00000100:00100000:0.0:1787384822.203280:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203467008 00000100:00100000:0.0:1787384822.203291:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203467648 00000100:00100000:0.0:1787384822.203294:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203467648 00000100:00100000:0.0:1787384822.203315:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787384822.203325:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203467776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384822.203412:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203467776:12345-0@lo:400:kworker.0 Request processed in 89us (2905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384822.203419:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787384822.203439:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787384822.203445:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203467520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384822.203481:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203467520:12345-0@lo:400:kworker.0 Request processed in 36us (2880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384822.203500:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787384822.203513:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787384822.203519:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203467008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384822.203552:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203467008:12345-0@lo:400:kworker.0 Request processed in 33us (2917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384822.203558:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787384822.203570:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787384822.203576:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203467648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384822.203606:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203467648:12345-0@lo:400:kworker.0 Request processed in 30us (2943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384822.203612:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:0.0:1787384822.203687:0:22738:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1787384822.203715:0:22738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22738:1874208203468160:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787384822.203760:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384822.203812:0:22738:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6374180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384822.203834:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203468160 00000100:00100000:0.0:1787384822.203838:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203468160 00000100:00100000:0.0:1787384822.203871:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384822.203879:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22738:x1874208203468160:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787384822.204153:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384822.204168:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203468032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384822.204203:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384822.204244:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203468032 00000100:00100000:0.0:1787384822.204249:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203468032 00000100:00100000:0.0:1787384822.204281:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384822.204294:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1874208203468032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384822.204314:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384822.204357:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1874208203468032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384822.204363:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787384822.204407:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee144380 x1874208203468032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384822.204430:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203468032:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787384822.204468:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f91d9880 x1874208203467008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384822.204479:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203467008:0@lo:400:kworker.0 00010000:00080000:0.0:1787384822.204492:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f91db800 x1874208203467648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384822.204502:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203467648:0@lo:400:kworker.0 00010000:00080000:0.0:1787384822.204515:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f91d9c00 x1874208203467520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384822.204523:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203467520:0@lo:400:kworker.0 00010000:00080000:0.0:1787384822.204558:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f91dad80 x1874208203467776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384822.204568:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203467776:0@lo:400:kworker.0 00000004:00080000:3.0:1787384822.207488:0:22737:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787384822.207629:0:22737:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717287849287ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787384822.207641:0:22737:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:2.0:1787384822.209219:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787384822.209232:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384822.209236:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384822.210881:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203468288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384822.211209:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384822.213180:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203468288 00000100:00100000:1.0:1787384822.213198:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203468288 00000100:00100000:1.0:1787384822.213275:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384822.213288:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203468288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384822.213322:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787384822.213433:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203468288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (2450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384822.213442:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787384822.213574:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee144380 x1874208203468288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384822.213599:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203468288:0@lo:13:osp-pre-0-1.0 00002000:00080000:2.0:1787384822.215942:0:24220:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787384822.215958:0:24220:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1787384822.215966:0:24220:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000004:00080000:0.0:1787384822.218299:0:22692:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787384822.248950:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384822.248967:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024f0c2a9/0x7ef423838fba44cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.248984:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787384822.248989:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384822.249016:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024f0c2a9/0x7ef423838fba44cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.249035:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024f0c2a9/0x7ef423838fba44cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.249046:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024f0c2a9/0x7ef423838fba44cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.249061:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024f0c2a9/0x7ef423838fba44cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.249086:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384822.249627:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384822.249642:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024f0c2a9/0x7ef423838fba44cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.249793:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384822.249801:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024f0c2a9/0x7ef423838fba44cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.249814:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024f0c2a9/0x7ef423838fba44cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.249912:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024f0c2a9/0x7ef423838fba44cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.249921:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024f0c2a9/0x7ef423838fba44cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.249952:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.249954:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.249956:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384822.250436:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384822.250448:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001762a557/0x7ef423838fba44d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.250462:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787384822.250466:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384822.250472:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001762a557/0x7ef423838fba44d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.250486:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001762a557/0x7ef423838fba44d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.250495:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001762a557/0x7ef423838fba44d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.250503:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001762a557/0x7ef423838fba44d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.250532:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384822.250969:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384822.250979:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001762a557/0x7ef423838fba44d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.250989:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384822.250994:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001762a557/0x7ef423838fba44d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.251005:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001762a557/0x7ef423838fba44d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.251048:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001762a557/0x7ef423838fba44d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.251056:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001762a557/0x7ef423838fba44d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.251081:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.251084:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.251086:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384822.255414:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384822.255430:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009597cbed/0x7ef423838fba44da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.255462:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787384822.255467:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384822.255473:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009597cbed/0x7ef423838fba44da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.255487:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009597cbed/0x7ef423838fba44da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.255497:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009597cbed/0x7ef423838fba44da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.255505:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009597cbed/0x7ef423838fba44da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.255537:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787384822.260511:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384822.260526:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002d5df61/0x7ef423838fba44e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.260544:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787384822.260547:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384822.260553:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002d5df61/0x7ef423838fba44e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.260567:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002d5df61/0x7ef423838fba44e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.260594:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002d5df61/0x7ef423838fba44e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.260600:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002d5df61/0x7ef423838fba44e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.260630:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787384822.260690:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384822.260712:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009597cbed/0x7ef423838fba44da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.260739:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384822.260746:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009597cbed/0x7ef423838fba44da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.260761:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009597cbed/0x7ef423838fba44da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.260820:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009597cbed/0x7ef423838fba44da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.260830:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009597cbed/0x7ef423838fba44da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.260864:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384822.260868:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002d5df61/0x7ef423838fba44e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.260875:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384822.260879:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002d5df61/0x7ef423838fba44e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.260906:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002d5df61/0x7ef423838fba44e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.260918:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002d5df61/0x7ef423838fba44e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.260925:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002d5df61/0x7ef423838fba44e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.260942:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.260944:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.260946:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.261360:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.264632:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.264647:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba44e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.264666:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.264671:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.264686:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba44e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.264702:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba44e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.264712:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba44e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.264720:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba44e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.264743:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384822.264854:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384822.264870:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba44e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.264884:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cda00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384822.264891:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba44e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.264903:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba44e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.264930:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba44e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.264959:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba44e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.265003:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.265005:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.265016:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384822.270049:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384822.270064:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c26e7ac/0x7ef423838fba44ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.270082:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787384822.270086:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384822.270092:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c26e7ac/0x7ef423838fba44ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.270106:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c26e7ac/0x7ef423838fba44ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.270117:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c26e7ac/0x7ef423838fba44ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.270125:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c26e7ac/0x7ef423838fba44ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.270385:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384822.270757:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384822.270765:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c26e7ac/0x7ef423838fba44ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.270774:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384822.270801:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c26e7ac/0x7ef423838fba44ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.270811:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c26e7ac/0x7ef423838fba44ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.270829:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c26e7ac/0x7ef423838fba44ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.270837:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c26e7ac/0x7ef423838fba44ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.270856:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.270858:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.270860:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384822.271171:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384822.271178:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2bdf4f/0x7ef423838fba44f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.271187:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787384822.271191:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384822.271195:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d2bdf4f/0x7ef423838fba44f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.271204:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d2bdf4f/0x7ef423838fba44f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.271211:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2bdf4f/0x7ef423838fba44f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.271218:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d2bdf4f/0x7ef423838fba44f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.271240:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384822.271533:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384822.271539:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d2bdf4f/0x7ef423838fba44f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.271549:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384822.271552:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2bdf4f/0x7ef423838fba44f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.271560:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2bdf4f/0x7ef423838fba44f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.271575:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d2bdf4f/0x7ef423838fba44f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.271583:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d2bdf4f/0x7ef423838fba44f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.271598:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.271599:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.271601:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384822.271689:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384822.271695:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bed7f74/0x7ef423838fba44fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.271704:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787384822.271714:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384822.271718:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bed7f74/0x7ef423838fba44fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.271728:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bed7f74/0x7ef423838fba44fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.271736:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bed7f74/0x7ef423838fba44fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.271743:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bed7f74/0x7ef423838fba44fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.271917:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787384822.274483:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384822.274497:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f8a8ba5/0x7ef423838fba4504 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.274513:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787384822.274517:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384822.274523:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f8a8ba5/0x7ef423838fba4504 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.274534:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f8a8ba5/0x7ef423838fba4504 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.274543:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f8a8ba5/0x7ef423838fba4504 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.274557:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f8a8ba5/0x7ef423838fba4504 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.277664:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384822.277677:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bed7f74/0x7ef423838fba44fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.277690:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384822.277695:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bed7f74/0x7ef423838fba44fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.277721:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bed7f74/0x7ef423838fba44fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.277742:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bed7f74/0x7ef423838fba44fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.277748:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bed7f74/0x7ef423838fba44fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.277768:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384822.277772:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f8a8ba5/0x7ef423838fba4504 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.277803:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384822.277807:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f8a8ba5/0x7ef423838fba4504 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.277814:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f8a8ba5/0x7ef423838fba4504 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.277823:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f8a8ba5/0x7ef423838fba4504 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.277831:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.277832:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.277840:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.280463:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787384822.280479:0:24220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f8a8ba5/0x7ef423838fba4504 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384822.281675:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384822.281684:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ddfdfe0/0x7ef423838fba450b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.281699:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787384822.281702:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384822.281708:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddfdfe0/0x7ef423838fba450b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.281720:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddfdfe0/0x7ef423838fba450b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.281728:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ddfdfe0/0x7ef423838fba450b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.281735:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ddfdfe0/0x7ef423838fba450b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.283268:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384822.283281:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ddfdfe0/0x7ef423838fba450b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.283295:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384822.283300:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddfdfe0/0x7ef423838fba450b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.283311:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddfdfe0/0x7ef423838fba450b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.283332:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ddfdfe0/0x7ef423838fba450b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.283341:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.283343:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.283345:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.285042:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787384822.285056:0:24220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddfdfe0/0x7ef423838fba450b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384822.287637:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384822.287651:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000035dc138/0x7ef423838fba4512 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.287668:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787384822.287673:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384822.287679:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000035dc138/0x7ef423838fba4512 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.287693:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000035dc138/0x7ef423838fba4512 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.287702:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000035dc138/0x7ef423838fba4512 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.287709:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000035dc138/0x7ef423838fba4512 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.288748:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384822.288758:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000035dc138/0x7ef423838fba4512 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.288769:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05a00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384822.288775:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000035dc138/0x7ef423838fba4512 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.288798:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000035dc138/0x7ef423838fba4512 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.288832:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000035dc138/0x7ef423838fba4512 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384822.288842:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.288844:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.288846:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.292319:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787384822.292332:0:24220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000035dc138/0x7ef423838fba4512 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.292430:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384822.293981:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384822.293991:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000397e1cf3/0x7ef423838fba4519 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.294015:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787384822.294020:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384822.294026:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000397e1cf3/0x7ef423838fba4519 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.294038:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000397e1cf3/0x7ef423838fba4519 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.294046:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000397e1cf3/0x7ef423838fba4519 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.294053:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000397e1cf3/0x7ef423838fba4519 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.294088:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384822.294199:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384822.294207:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000397e1cf3/0x7ef423838fba4519 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.294216:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384822.294221:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000397e1cf3/0x7ef423838fba4519 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.294230:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000397e1cf3/0x7ef423838fba4519 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.294248:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000397e1cf3/0x7ef423838fba4519 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.294266:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000397e1cf3/0x7ef423838fba4519 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.294285:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384822.294287:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384822.294288:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384822.294896:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384822.294903:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d40a99bf/0x7ef423838fba4520 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.294913:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787384822.294917:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384822.294921:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d40a99bf/0x7ef423838fba4520 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.294931:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d40a99bf/0x7ef423838fba4520 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.294939:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d40a99bf/0x7ef423838fba4520 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.294945:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d40a99bf/0x7ef423838fba4520 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.294961:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787384822.295386:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384822.295392:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008231b2c6/0x7ef423838fba4527 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.295402:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787384822.295411:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384822.295415:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008231b2c6/0x7ef423838fba4527 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.295424:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008231b2c6/0x7ef423838fba4527 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.295432:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008231b2c6/0x7ef423838fba4527 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.295438:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008231b2c6/0x7ef423838fba4527 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.295458:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787384822.295683:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384822.295689:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d40a99bf/0x7ef423838fba4520 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.295698:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384822.295702:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d40a99bf/0x7ef423838fba4520 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.295709:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d40a99bf/0x7ef423838fba4520 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.295724:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d40a99bf/0x7ef423838fba4520 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.295730:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d40a99bf/0x7ef423838fba4520 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.295746:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384822.295750:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008231b2c6/0x7ef423838fba4527 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.295762:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384822.295765:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008231b2c6/0x7ef423838fba4527 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.295772:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008231b2c6/0x7ef423838fba4527 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.295803:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008231b2c6/0x7ef423838fba4527 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.295810:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008231b2c6/0x7ef423838fba4527 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.295825:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384822.295826:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384822.295828:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384822.295926:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384822.295932:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae0d451/0x7ef423838fba452e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.295940:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787384822.295943:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384822.295948:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ae0d451/0x7ef423838fba452e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.295957:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ae0d451/0x7ef423838fba452e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.295965:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae0d451/0x7ef423838fba452e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.295978:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ae0d451/0x7ef423838fba452e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.295997:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384822.296355:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384822.296360:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ae0d451/0x7ef423838fba452e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.296368:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384822.296371:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae0d451/0x7ef423838fba452e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.296379:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae0d451/0x7ef423838fba452e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.296398:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ae0d451/0x7ef423838fba452e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.296406:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ae0d451/0x7ef423838fba452e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.296420:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384822.296422:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384822.296424:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384822.296500:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384822.296505:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ee5036/0x7ef423838fba4535 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.296514:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787384822.296517:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384822.296521:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ee5036/0x7ef423838fba4535 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.296529:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2ee5036/0x7ef423838fba4535 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.296536:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ee5036/0x7ef423838fba4535 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.296542:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ee5036/0x7ef423838fba4535 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.298029:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384822.300613:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384822.300627:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2ee5036/0x7ef423838fba4535 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.300642:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384822.300647:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ee5036/0x7ef423838fba4535 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.300658:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ee5036/0x7ef423838fba4535 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.300682:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2ee5036/0x7ef423838fba4535 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.300694:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2ee5036/0x7ef423838fba4535 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.300740:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384822.300742:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384822.300744:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384822.301070:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.305043:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.305057:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cb748c6/0x7ef423838fba453c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305074:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.305078:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.305085:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cb748c6/0x7ef423838fba453c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305099:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cb748c6/0x7ef423838fba453c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305109:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cb748c6/0x7ef423838fba453c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305117:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cb748c6/0x7ef423838fba453c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305146:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384822.305157:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384822.305163:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cb748c6/0x7ef423838fba453c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305185:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384822.305190:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cb748c6/0x7ef423838fba453c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305198:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cb748c6/0x7ef423838fba453c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305215:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cb748c6/0x7ef423838fba453c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305223:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cb748c6/0x7ef423838fba453c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305239:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384822.305240:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384822.305242:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.305930:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.305938:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8fae64/0x7ef423838fba4543 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305950:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.305953:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.305958:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df8fae64/0x7ef423838fba4543 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305967:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df8fae64/0x7ef423838fba4543 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305984:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8fae64/0x7ef423838fba4543 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.305992:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df8fae64/0x7ef423838fba4543 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.306017:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384822.306075:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384822.306083:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df8fae64/0x7ef423838fba4543 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.306092:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384822.306096:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8fae64/0x7ef423838fba4543 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.306104:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8fae64/0x7ef423838fba4543 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.306118:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df8fae64/0x7ef423838fba4543 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.306125:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df8fae64/0x7ef423838fba4543 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.306141:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.306143:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.306145:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.306589:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.306597:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000534d2e0f/0x7ef423838fba454a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.306607:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.306610:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.306614:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000534d2e0f/0x7ef423838fba454a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.306623:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000534d2e0f/0x7ef423838fba454a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.306630:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000534d2e0f/0x7ef423838fba454a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.306637:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000534d2e0f/0x7ef423838fba454a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.306672:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384822.307078:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384822.307085:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000534d2e0f/0x7ef423838fba454a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.307100:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58ccc00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384822.307104:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000534d2e0f/0x7ef423838fba454a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.307113:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000534d2e0f/0x7ef423838fba454a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.307127:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000534d2e0f/0x7ef423838fba454a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.307188:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000534d2e0f/0x7ef423838fba454a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.307205:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384822.307206:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384822.307208:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.307306:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.307313:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba4551 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.307322:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.307326:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.307330:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba4551 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.307340:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba4551 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.307347:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba4551 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.307354:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba4551 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.307374:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384822.307398:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384822.307405:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba4551 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.307415:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384822.307427:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba4551 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.307437:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba4551 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.307450:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba4551 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.307459:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba4551 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.307484:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.307486:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.307488:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.307645:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.307650:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f2fd833/0x7ef423838fba4558 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.307658:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.307667:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.307671:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f2fd833/0x7ef423838fba4558 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.307681:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f2fd833/0x7ef423838fba4558 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.307689:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f2fd833/0x7ef423838fba4558 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.307696:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f2fd833/0x7ef423838fba4558 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.307749:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384822.308205:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384822.308211:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f2fd833/0x7ef423838fba4558 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.308220:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cde00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384822.308223:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f2fd833/0x7ef423838fba4558 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.308232:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f2fd833/0x7ef423838fba4558 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.308251:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f2fd833/0x7ef423838fba4558 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.308258:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f2fd833/0x7ef423838fba4558 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.308274:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384822.308275:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384822.308277:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.308371:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.308377:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f3dc03/0x7ef423838fba455f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.308387:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.308390:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.308394:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030f3dc03/0x7ef423838fba455f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.308402:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030f3dc03/0x7ef423838fba455f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.308410:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f3dc03/0x7ef423838fba455f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.308424:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030f3dc03/0x7ef423838fba455f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.308445:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384822.308566:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384822.308572:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030f3dc03/0x7ef423838fba455f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.308580:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384822.308584:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f3dc03/0x7ef423838fba455f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.308591:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f3dc03/0x7ef423838fba455f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.308603:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030f3dc03/0x7ef423838fba455f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.308618:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030f3dc03/0x7ef423838fba455f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.308644:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.308646:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.308649:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.308714:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.308720:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060827ab6/0x7ef423838fba4566 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.308729:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.308732:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.308736:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060827ab6/0x7ef423838fba4566 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.308746:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060827ab6/0x7ef423838fba4566 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.308754:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060827ab6/0x7ef423838fba4566 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.308761:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060827ab6/0x7ef423838fba4566 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.308799:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384822.309202:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384822.309208:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060827ab6/0x7ef423838fba4566 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.309217:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384822.309220:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060827ab6/0x7ef423838fba4566 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.309227:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060827ab6/0x7ef423838fba4566 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.309240:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060827ab6/0x7ef423838fba4566 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.309246:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060827ab6/0x7ef423838fba4566 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.309272:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384822.309274:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384822.309275:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.309348:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.309354:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba456d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.309368:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.309372:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.309376:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba456d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.309385:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba456d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.309392:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba456d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.309399:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba456d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.309419:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384822.309548:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384822.309554:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba456d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.309561:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384822.309565:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba456d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.309573:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba456d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.309585:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba456d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.309593:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba456d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.309610:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.309612:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.309614:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.309676:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.309682:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba4574 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.309690:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.309693:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.309698:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba4574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.309706:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba4574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.309724:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba4574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.309732:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba4574 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.309752:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787384822.312105:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.312118:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba457b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.312228:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384822.312236:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba4574 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.312245:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384822.312250:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba4574 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.312260:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba4574 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.312278:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba4574 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.312285:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba4574 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.312302:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384822.312304:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384822.312306:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384822.312334:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.312339:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.312346:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba457b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.312359:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba457b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.312369:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba457b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.312376:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba457b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.312409:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384822.312454:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384822.312462:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba457b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.312480:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cda00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384822.312483:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba457b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.312492:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba457b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.312506:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba457b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.312513:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071fbbd72/0x7ef423838fba457b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.312531:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.312534:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.312535:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.313154:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.313162:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dde3f21d/0x7ef423838fba4582 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.313171:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.313174:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.313178:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dde3f21d/0x7ef423838fba4582 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.313186:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dde3f21d/0x7ef423838fba4582 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.313193:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dde3f21d/0x7ef423838fba4582 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.313199:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dde3f21d/0x7ef423838fba4582 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.313252:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787384822.313575:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.313581:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cec8efca/0x7ef423838fba4589 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.313590:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.313600:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.313605:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cec8efca/0x7ef423838fba4589 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.313614:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cec8efca/0x7ef423838fba4589 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.313622:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cec8efca/0x7ef423838fba4589 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.313629:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cec8efca/0x7ef423838fba4589 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.313668:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384822.313675:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dde3f21d/0x7ef423838fba4582 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.313692:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384822.313697:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dde3f21d/0x7ef423838fba4582 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.314377:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dde3f21d/0x7ef423838fba4582 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.314399:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dde3f21d/0x7ef423838fba4582 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.314406:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dde3f21d/0x7ef423838fba4582 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.314432:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384822.314437:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cec8efca/0x7ef423838fba4589 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.314443:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384822.314446:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cec8efca/0x7ef423838fba4589 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.314453:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cec8efca/0x7ef423838fba4589 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.314462:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cec8efca/0x7ef423838fba4589 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384822.314479:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384822.314480:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384822.314483:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384822.314636:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787384822.314643:0:24220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cec8efca/0x7ef423838fba4589 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.314943:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.315190:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.315198:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094982267/0x7ef423838fba4590 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.315208:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.315211:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.315216:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094982267/0x7ef423838fba4590 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.315227:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094982267/0x7ef423838fba4590 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.315243:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094982267/0x7ef423838fba4590 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.315251:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094982267/0x7ef423838fba4590 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.315274:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384822.315529:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384822.315535:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094982267/0x7ef423838fba4590 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.315542:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384822.315546:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094982267/0x7ef423838fba4590 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.315566:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094982267/0x7ef423838fba4590 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.315579:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094982267/0x7ef423838fba4590 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.315586:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094982267/0x7ef423838fba4590 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.315602:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.315604:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.315606:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.316233:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.316240:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f37484b5/0x7ef423838fba4597 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.316251:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.316254:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.316259:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f37484b5/0x7ef423838fba4597 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.316270:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f37484b5/0x7ef423838fba4597 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.316277:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f37484b5/0x7ef423838fba4597 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.316284:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f37484b5/0x7ef423838fba4597 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.316318:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384822.317570:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384822.317580:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f37484b5/0x7ef423838fba4597 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.317592:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384822.317596:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f37484b5/0x7ef423838fba4597 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.317606:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f37484b5/0x7ef423838fba4597 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.317624:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f37484b5/0x7ef423838fba4597 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.317643:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f37484b5/0x7ef423838fba4597 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.317663:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.317665:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.317667:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.318529:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.318538:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe722f5c/0x7ef423838fba459e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.318551:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.318555:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.318560:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe722f5c/0x7ef423838fba459e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.318570:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe722f5c/0x7ef423838fba459e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.318577:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe722f5c/0x7ef423838fba459e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.318584:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe722f5c/0x7ef423838fba459e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.318608:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384822.318899:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384822.318905:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe722f5c/0x7ef423838fba459e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.318913:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384822.318917:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe722f5c/0x7ef423838fba459e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.318925:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe722f5c/0x7ef423838fba459e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.318941:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe722f5c/0x7ef423838fba459e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.318947:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe722f5c/0x7ef423838fba459e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.318964:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.318966:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.318967:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384822.319167:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384822.319173:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000401bbf6/0x7ef423838fba45a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.319181:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787384822.319188:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384822.319192:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000401bbf6/0x7ef423838fba45a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.319201:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000401bbf6/0x7ef423838fba45a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.319209:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000401bbf6/0x7ef423838fba45a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.319215:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000401bbf6/0x7ef423838fba45a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384822.319234:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787384822.319524:0:24220:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1787384822.319615:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22738:x1874208203468160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 115733us (115850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384822.319625:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384822.319771:0:22738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22738:1874208203468160:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787384822.319807:0:22738:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1787384822.319852:0:22738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22738:1874208203468416:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787384822.319910:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384822.319936:0:22738:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948b40 going to sleep for 11 seconds 00010000:00010000:0.0:1787384822.319950:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384822.319955:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000401bbf6/0x7ef423838fba45a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.319963:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384822.319966:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000401bbf6/0x7ef423838fba45a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.319976:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000401bbf6/0x7ef423838fba45a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.319990:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000401bbf6/0x7ef423838fba45a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.319997:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000401bbf6/0x7ef423838fba45a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384822.320022:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.320024:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384822.320026:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384822.320412:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203468416 00000100:00100000:2.0:1787384822.320421:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203468416 00000100:00100000:2.0:1787384822.320472:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384822.320481:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22738:x1874208203468416:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787384822.320516:0:24218:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:2.0:1787384822.323587:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1787384822.323634:0:24215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787384822.323831:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22738:x1874208203468416:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3346us (3919us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1787384822.323850:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384822.323993:0:22738:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787384822.324002:0:22738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22738:1874208203468416:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787384822.324025:0:22738:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1787384822.647917:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384823.223959:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203468544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384823.224036:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384823.229406:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203468544 00000100:00100000:1.0:1787384823.229424:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203468544 00000100:00100000:1.0:1787384823.231230:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384823.231247:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203468544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384823.231285:0:22718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384823.231361:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203468544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (7325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384823.231369:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787384823.231950:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384803/real 1787384803] req@ffff98f8f4a44a80 x1874208203458560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384823 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384823.231970:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f4a44a80 x1874208203458560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384823 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384823.231985:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d9b5c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384823.232012:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787384823.232016:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203458560:0@lo:8:kworker.0 00000100:00100000:2.0:1787384823.232043:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203468672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384823.232084:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787384823.239577:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384823.239584:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787384823.239587:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8d9b5c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384823.239594:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 698 00000100:00080000:2.0:1787384823.239600:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787384823.239606:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f8d9b5c800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384823.239628:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f91d8380 x1874208203469056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384823.239657:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384823.239660:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787384823.239662:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384823.239666:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 717 00000100:00080000:2.0:1787384823.239668:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787384823.239672:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f943d000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384823.239683:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f91da300 x1874208203469440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787384823.239726:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203468800:0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.239805:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384823.239840:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203469568:0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.239866:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384823.239891:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384823.239896:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203469312:0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.239930:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384823.239961:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203469056:0@lo:8:kworker.0 00000100:00100000:2.0:1787384823.239989:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384823.240028:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203469440:0@lo:8:kworker.0 00000100:00100000:2.0:1787384823.240051:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384823.240082:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203468800 00000100:00100000:2.0:1787384823.240089:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203468800 00000100:00100000:2.0:1787384823.240144:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787384823.240154:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+21:3652:x1874208203468800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.240203:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+21:3652:x1874208203468800:12345-0@lo:400:kworker.0 Request processed in 50us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384823.240210:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787384823.240242:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203469568 00000100:00100000:2.0:1787384823.240246:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203469568 00000100:00100000:2.0:1787384823.240270:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787384823.240277:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203469568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.240319:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203469568:12345-0@lo:400:kworker.0 Request processed in 43us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384823.240326:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787384823.240344:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203469312 00000100:00100000:2.0:1787384823.240348:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203469312 00000100:00100000:2.0:1787384823.240369:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203469056 00000100:00100000:2.0:1787384823.240371:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203469056 00000100:00100000:2.0:1787384823.240381:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203469440 00000100:00100000:2.0:1787384823.240383:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203469440 00000100:00100000:2.0:1787384823.240391:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384823.240397:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203469312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.240440:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203469312:12345-0@lo:400:kworker.0 Request processed in 43us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384823.240447:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384823.240459:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384823.240469:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874208203469056:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787384823.240486:0:24221:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787384823.240518:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874208203469056:12345-0@lo:8:kworker.0 Request processed in 48us (527us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787384823.240526:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384823.240537:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384823.240541:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874208203469440:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787384823.240550:0:24221:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787384823.240574:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874208203469440:12345-0@lo:8:kworker.0 Request processed in 31us (521us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787384823.240579:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384823.240619:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203469312:0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.240630:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203468800:0@lo:400:kworker.0 00010000:00080000:2.0:1787384823.240639:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f91d9500 x1874208203469568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384823.240649:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203469568:0@lo:400:kworker.0 00000100:00080000:2.0:1787384823.240687:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d9b5c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384823.240691:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787384823.240695:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203469056:0@lo:8:kworker.0 00000100:00080000:2.0:1787384823.240703:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384823.240706:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787384823.240709:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203469440:0@lo:8:kworker.0 00000100:00100000:2.0:1787384823.243552:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203468928:0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.243623:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384823.243646:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203468672 00000100:00100000:3.0:1787384823.243655:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203468672 00000100:00100000:2.0:1787384823.243656:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203469696:0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.243679:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384823.243700:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787384823.243707:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203469184:0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.243725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384823.243740:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203469824:0@lo:400:kworker.0 00000100:00100000:3.0:1787384823.243743:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384823.243752:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203468672:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384823.243757:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1787384823.243797:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787384823.243801:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203468928 00000100:00100000:2.0:1787384823.243804:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203468928 00000100:00100000:2.0:1787384823.243827:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384823.243833:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203468928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384823.243841:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203468672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (11757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384823.243848:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787384823.243864:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203468928:12345-0@lo:400:kworker.0 Request processed in 32us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384823.243870:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384823.243885:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203469696 00000100:00100000:2.0:1787384823.243889:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203469696 00000100:00100000:2.0:1787384823.243902:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203469184 00000100:00100000:2.0:1787384823.243904:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203469184 00000100:00100000:3.0:1787384823.243908:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203468672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384823.243913:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203469824 00000100:00100000:2.0:1787384823.244018:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203469824 00000100:00100000:2.0:1787384823.244042:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384823.244049:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203469696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.244078:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203469696:12345-0@lo:400:kworker.0 Request processed in 29us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384823.244083:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384823.244093:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787384823.244105:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203469184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384823.244117:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203468544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384823.244197:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203469184:12345-0@lo:400:kworker.0 Request processed in 91us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384823.244203:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787384823.244216:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787384823.244222:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203469824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.244249:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203469824:12345-0@lo:400:kworker.0 Request processed in 28us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384823.244254:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787384823.244357:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f91d9180 x1874208203469184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384823.244368:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203469184:0@lo:400:kworker.0 00010000:00080000:2.0:1787384823.244380:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f9149c00 x1874208203469824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384823.244388:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203469824:0@lo:400:kworker.0 00000100:00100000:2.0:1787384823.244397:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203468928:0@lo:400:kworker.0 00010000:00080000:2.0:1787384823.244405:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f9149500 x1874208203469696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384823.244413:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203469696:0@lo:400:kworker.0 00010000:00010000:0.0:1787384823.670984:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787384824.187910:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787384824.698875:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787384824.961397:0:25032:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787384824.961401:0:25032:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787384824.961402:0:25032:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787384824.961886:0:25032:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98f8f5698000 00000020:01000004:2.0:1787384824.961903:0:25032:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787384824.962069:0:25032:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787384824.962230:0:25032:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98f7c4030000) 00000020:00000080:2.0:1787384824.962247:0:25032:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787384825.018555:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787384825.021718:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787384825.022077:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787384825.022498:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787384825.023200:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787384825.023983:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787384825.024598:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1787384825.026260:0:25032:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787384825.026751:0:25032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787384825.026765:0:25032:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787384825.027066:0:25032:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7ef423838fba45b3 00000020:01000004:1.0:1787384825.027073:0:25032:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787384825.027276:0:25032:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.145@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787384825.027280:0:25032:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787384825.027286:0:25032:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787384825.027314:0:25032:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787384825.027318:0:25032:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787384825.048056:0:25032:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787384825.048126:0:25032:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.145@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787384825.048131:0:25032:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787384825.048132:0:25032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384825.048134:0:25032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384825.048135:0:25032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384825.048136:0:25032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384825.048137:0:25032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384825.048139:0:25032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384825.048140:0:25032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384825.048142:0:25032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384825.048146:0:25032:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787384825.048148:0:25032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384825.048149:0:25032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384825.048150:0:25032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384825.048151:0:25032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384825.048152:0:25032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384825.048153:0:25032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384825.048154:0:25032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384825.048154:0:25032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384825.048155:0:25032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384825.048180:0:25032:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787384825.048201:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203469952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787384825.048272:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.048319:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e87e86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384825.050117:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203469952 00000100:00100000:0.0:1787384825.050130:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203469952 00000100:00100000:0.0:1787384825.050189:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787384825.050199:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+21:25032:x1874208203469952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787384825.050235:0:22706:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787384825.050238:0:22706:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787384825.050242:0:22706:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787384825.051411:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+21:25032:x1874208203469952:12345-0@lo:253:mount.lustre.0 Request processed in 1209us (3135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384825.051521:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203469952:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787384825.051535:0:25032:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787384825.051538:0:25032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384825.051540:0:25032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384825.051541:0:25032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384825.051543:0:25032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384825.051544:0:25032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384825.051546:0:25032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384825.051547:0:25032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384825.051549:0:25032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384825.051563:0:25032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787384825.051585:0:25032:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f8f5698000 from lustre-OST0001 10000000:01000000:3.0:1787384825.051626:0:25032:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787384825.051629:0:25032:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787384825.051637:0:25032:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f7c2898000 local copy 00010000:00010000:3.0:1787384825.051648:0:25032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384825.051756:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384825.051830:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.051866:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e87e8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787384825.051894:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203470080 00000100:00100000:2.0:1787384825.051902:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203470080 00000100:00100000:0.0:1787384825.052256:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787384825.052595:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787384825.052606:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:25032:x1874208203470080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384825.052947:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:25032:x1874208203470080:12345-0@lo:501:mount.lustre.0 Request processed in 342us (1116us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787384825.052953:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787384825.053023:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470080:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787384825.053040:0:25032:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787384825.053060:0:25032:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787384825.053067:0:25032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384825.053226:0:25032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba41e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba41ed expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384825.053260:0:25032:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f8f5698000 10000000:01000000:3.0:1787384825.053264:0:25032:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787384825.053270:0:25032:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787384825.053273:0:25032:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384825.053276:0:25032:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787384825.053279:0:25032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787384825.053303:0:25032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824e00/0x7ef423838fba45ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384825.053312:0:25032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5824e00/0x7ef423838fba45ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384825.053331:0:25032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5824e00/0x7ef423838fba45ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384825.053347:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384825.053376:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.053409:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e87e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787384825.054252:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203470208 00000100:00100000:0.0:1787384825.054261:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203470208 00000100:00100000:0.0:1787384825.054315:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787384825.054324:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+21:25032:x1874208203470208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384825.054335:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384825.054349:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba45c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba45ba expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.054373:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba45c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba45ba expref: 22 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.054384:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba45c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba45ba expref: 22 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.054393:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05e00, rc 0) 00000100:00100000:0.0:1787384825.054523:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+22:25032:x1874208203470208:12345-0@lo:101:mount.lustre.0 Request processed in 200us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384825.054531:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787384825.055004:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384825.055021:0:25032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5824e00/0x7ef423838fba45ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba45c1 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384825.055031:0:25032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5824e00/0x7ef423838fba45ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba45c1 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384825.058507:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1787384825.061551:0:25032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384825.065553:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787384825.065607:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1787384825.065622:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1787384825.065636:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1787384825.065649:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1787384825.065662:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1787384825.065681:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1787384825.065695:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1787384825.065711:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1787384825.065735:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1787384825.065740:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1787384825.065973:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384825.066050:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.066152:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e87e8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787384825.066374:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203470336 00000100:00100000:2.0:1787384825.066382:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203470336 00000100:00100000:2.0:1787384825.066526:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787384825.066535:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+22:25032:x1874208203470336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384825.066678:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+22:25032:x1874208203470336:12345-0@lo:501:mount.lustre.0 Request processed in 143us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384825.066686:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787384825.066755:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384825.066814:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384825.066853:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.067019:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e87e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787384825.067306:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203470464 00000100:00100000:0.0:1787384825.067312:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203470464 00000100:00100000:0.0:1787384825.067347:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787384825.067354:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+22:25032:x1874208203470464:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384825.068073:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+22:25032:x1874208203470464:12345-0@lo:503:mount.lustre.0 Request processed in 718us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384825.068091:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787384825.068590:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470464:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787384825.069036:0:25032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384825.070393:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384825.070539:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.070618:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e87e8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384825.072218:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203470592 00000100:00100000:1.0:1787384825.072230:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203470592 00000100:00100000:2.0:1787384825.072875:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787384825.072888:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+22:25032:x1874208203470592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384825.073854:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+22:25032:x1874208203470592:12345-0@lo:502:mount.lustre.0 Request processed in 965us (3311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384825.073865:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787384825.073969:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384825.074706:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787384825.074736:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1787384825.074749:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1787384825.074761:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1787384825.074773:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1787384825.074817:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1787384825.074831:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1787384825.074843:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1787384825.074855:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1787384825.074889:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384825.074939:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384825.074971:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384825.075058:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203470720 00000100:00100000:3.0:1787384825.075065:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203470720 00000100:00100000:3.0:1787384825.075109:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787384825.075125:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+22:25032:x1874208203470720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384825.075214:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+22:25032:x1874208203470720:12345-0@lo:502:mount.lustre.0 Request processed in 90us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384825.075222:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787384825.075403:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384825.075461:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1787384825.075469:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1787384825.076298:0:25036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787384825.076313:0:25036:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787384825.076319:0:25036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384825.076321:0:25036:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787384825.076328:0:25036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787384825.076341:0:25036:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98f8fc2b0000) 00000020:00000080:0.0:1787384825.076366:0:25036:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787384825.076372:0:25036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787384825.076510:0:25036:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f5698000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787384825.076519:0:25036:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787384825.076527:0:25036:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7ef423838fba45cf 00010000:00010000:0.0:1787384825.082054:0:25036:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1787384825.082638:0:25036:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:0.0:1787384825.084614:0:25036:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787384825.085939:0:25036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787384825.085952:0:25036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384825.085957:0:25036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384825.085959:0:25036:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787384825.085963:0:25036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384825.085967:0:25036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384825.085969:0:25036:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787384825.085971:0:25036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787384825.085973:0:25036:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787384825.085976:0:25036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384825.085978:0:25036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384825.085979:0:25036:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787384825.085982:0:25036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384825.085984:0:25036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384825.085985:0:25036:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787384825.086000:0:25036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787384825.086028:0:25036:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384825.086031:0:25036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384825.086033:0:25036:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787384825.086036:0:25036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1787384825.088359:0:25032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787384825.088414:0:25032:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787384825.088492:0:25032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824e00/0x7ef423838fba45ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba45c1 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384825.088505:0:25032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5824e00/0x7ef423838fba45ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba45c1 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384825.088521:0:25032:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f5698000 from 1 10000000:01000000:2.0:1787384825.088524:0:25032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787384825.088560:0:25032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384825.088568:0:25032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384825.088579:0:25032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384825.088602:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787384825.088670:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.089733:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc33b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384825.094547:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203470848 00000100:00100000:0.0:1787384825.094561:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203470848 00000100:00100000:0.0:1787384825.094622:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787384825.094632:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+22:25032:x1874208203470848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384825.094648:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384825.094668:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b04800/0x7ef423838fba45dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba45d6 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.095212:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b04800/0x7ef423838fba45dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba45d6 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.095225:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b04800/0x7ef423838fba45dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba45d6 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.095235:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04800, rc 0) 00000100:00100000:0.0:1787384825.095302:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+23:25032:x1874208203470848:12345-0@lo:101:mount.lustre.0 Request processed in 672us (6632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384825.095310:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787384825.095520:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384825.095539:0:25032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba45dd expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384825.095548:0:25032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba45dd expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384825.097399:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1787384825.098030:0:25032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384825.099272:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787384825.099315:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1787384825.099331:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1787384825.099344:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1787384825.099357:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1787384825.099382:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1787384825.099396:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1787384825.099410:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1787384825.099499:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1787384825.099532:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1787384825.099547:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1787384825.099569:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1787384825.099573:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1787384825.099672:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384825.099949:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.100037:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc33be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384825.100213:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203470976 00000100:00100000:0.0:1787384825.100221:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203470976 00000100:00100000:0.0:1787384825.100298:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787384825.100307:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+23:25032:x1874208203470976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384825.100434:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+23:25032:x1874208203470976:12345-0@lo:501:mount.lustre.0 Request processed in 127us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384825.100442:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787384825.100510:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203470976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384825.100545:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384825.100585:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.100958:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc33be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384825.101398:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203471104 00000100:00100000:3.0:1787384825.101405:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203471104 00000100:00100000:0.0:1787384825.101529:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787384825.101538:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+23:25032:x1874208203471104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384825.101660:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+23:25032:x1874208203471104:12345-0@lo:503:mount.lustre.0 Request processed in 123us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384825.101675:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787384825.101769:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787384825.102214:0:25032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787384825.102286:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384825.102348:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.102920:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc33b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787384825.102978:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203471232 00000100:00100000:1.0:1787384825.102984:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203471232 00000100:00100000:1.0:1787384825.103025:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787384825.103033:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+23:25032:x1874208203471232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384825.103157:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+23:25032:x1874208203471232:12345-0@lo:502:mount.lustre.0 Request processed in 124us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384825.103166:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787384825.103248:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384825.103435:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787384825.103462:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1787384825.103476:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1787384825.103490:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1787384825.103501:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1787384825.103513:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1787384825.103536:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1787384825.103548:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1787384825.103559:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1787384825.103571:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1787384825.103583:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1787384825.103617:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384825.103756:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.103796:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc33b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787384825.104014:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203471360 00000100:00100000:1.0:1787384825.104019:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203471360 00000100:00100000:1.0:1787384825.104044:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787384825.104050:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+23:25032:x1874208203471360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384825.104143:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+23:25032:x1874208203471360:12345-0@lo:502:mount.lustre.0 Request processed in 92us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384825.104150:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787384825.104322:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384825.104365:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1787384825.104375:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787384825.105261:0:25040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384825.105279:0:25040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384825.105281:0:25040:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787384825.105288:0:25040:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f5698000 00000020:00000080:1.0:1787384825.105291:0:25040:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787384825.105299:0:25040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384825.105301:0:25040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384825.105303:0:25040:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787384825.105305:0:25040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384825.105307:0:25040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384825.105308:0:25040:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787384825.105312:0:25040:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f5698000 00000020:00000080:1.0:1787384825.105314:0:25040:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787384825.105373:0:25040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384825.105378:0:25040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384825.105379:0:25040:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787384825.105382:0:25040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384825.105384:0:25040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384825.105385:0:25040:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787384825.105389:0:25040:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f5698000 00000020:00000080:1.0:1787384825.105391:0:25040:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787384825.105433:0:25040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384825.105437:0:25040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384825.105439:0:25040:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787384825.105441:0:25040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384825.105444:0:25040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384825.105445:0:25040:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787384825.105449:0:25040:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f5698000 00000020:00000080:1.0:1787384825.105451:0:25040:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787384825.105474:0:25040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384825.105477:0:25040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384825.105479:0:25040:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787384825.105482:0:25040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1787384825.107920:0:25032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787384825.107968:0:25032:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384825.108004:0:25032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba45dd expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384825.108018:0:25032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba45dd expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384825.109204:0:25032:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787384825.109208:0:25032:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f8f5698000 10000000:01000000:3.0:1787384825.109212:0:25032:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f8f5698000 10000000:01000000:3.0:1787384825.109216:0:25032:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384825.109223:0:25032:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f5698000 from 1 10000000:01000000:3.0:1787384825.109226:0:25032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787384825.109263:0:25032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba45e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384825.109273:0:25032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba45e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384825.109284:0:25032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba45e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384825.109307:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384825.109365:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.116568:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e87e8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787384825.116770:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203471488 00000100:00100000:1.0:1787384825.117237:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203471488 00000100:00100000:1.0:1787384825.117502:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787384825.117512:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+23:25032:x1874208203471488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384825.117527:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384825.117545:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965aa00/0x7ef423838fba45eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba45e4 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384825.117571:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965aa00/0x7ef423838fba45eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba45e4 expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384825.117581:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965aa00/0x7ef423838fba45eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba45e4 expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384825.117589:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965aa00, rc 0) 00000100:00100000:1.0:1787384825.117659:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+24:25032:x1874208203471488:12345-0@lo:101:mount.lustre.0 Request processed in 149us (8293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384825.117666:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787384825.118068:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384825.118095:0:25032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba45e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba45eb expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384825.118105:0:25032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba45e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba45eb expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384825.121927:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1787384825.122283:0:25032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384825.122462:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1787384825.122486:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1787384825.122500:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1787384825.122527:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1787384825.122542:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1787384825.122555:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1787384825.122568:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1787384825.122583:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1787384825.122667:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1787384825.122693:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1787384825.122707:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1787384825.122720:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1787384825.122733:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1787384825.122744:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1787384825.122761:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1787384825.122775:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1787384825.123100:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1787384825.123191:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1787384825.123216:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1787384825.123252:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1787384825.123275:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1787384825.123297:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1787384825.123314:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1787384825.123333:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1787384825.123354:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1787384825.123372:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1787384825.123393:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1787384825.123411:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1787384825.123431:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1787384825.123448:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1787384825.123463:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1787384825.123477:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1787384825.123491:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1787384825.123505:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1787384825.123519:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1787384825.123548:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1787384825.123565:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1787384825.123583:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1787384825.124080:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1787384825.124100:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1787384825.124128:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1787384825.124144:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1787384825.124174:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1787384825.124190:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1787384825.124207:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1787384825.124221:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1787384825.124237:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1787384825.124253:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1787384825.124401:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1787384825.124425:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1787384825.124459:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1787384825.124466:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1787384825.124578:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384825.124658:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.124693:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e87e8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384825.126586:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203471616 00000100:00100000:0.0:1787384825.126600:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203471616 00000100:00100000:0.0:1787384825.127767:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787384825.127797:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+24:25032:x1874208203471616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384825.127963:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+24:25032:x1874208203471616:12345-0@lo:501:mount.lustre.0 Request processed in 173us (3305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384825.128658:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384825.128712:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384825.128774:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.128820:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e87e8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384825.128837:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203471744 00000100:00100000:3.0:1787384825.129136:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203471744 00000100:00100000:3.0:1787384825.129187:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787384825.129203:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+25:25032:x1874208203471744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384825.129447:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+25:25032:x1874208203471744:12345-0@lo:503:mount.lustre.0 Request processed in 247us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384825.129455:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787384825.129504:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787384825.130427:0:25032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384825.130510:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384825.130639:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.130673:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e87e8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384825.130698:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203471872 00000100:00100000:3.0:1787384825.130703:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203471872 00000100:00100000:3.0:1787384825.130730:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787384825.130737:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+25:25032:x1874208203471872:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384825.131138:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+25:25032:x1874208203471872:12345-0@lo:502:mount.lustre.0 Request processed in 400us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384825.131147:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787384825.131287:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203471872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787384825.131830:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787384825.132096:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1787384825.132112:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1787384825.132127:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1787384825.132140:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1787384825.132153:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1787384825.132167:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1787384825.132179:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1787384825.132191:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787384825.132537:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1787384825.132627:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1787384825.132652:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1787384825.132680:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1787384825.132695:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1787384825.132708:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1787384825.132720:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1787384825.132733:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1787384825.132745:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1787384825.132757:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1787384825.132808:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1787384825.132825:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787384825.133062:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787384825.133082:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787384825.133097:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787384825.133111:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1787384825.133124:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1787384825.133137:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1787384825.133151:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1787384825.133183:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1787384825.133205:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1787384825.133296:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1787384825.133311:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1787384825.133327:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1787384825.133410:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1787384825.133430:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1787384825.133446:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1787384825.133460:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1787384825.133473:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1787384825.133487:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1787384825.133500:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1787384825.133518:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1787384825.133533:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1787384825.133548:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1787384825.133560:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1787384825.133655:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1787384825.133671:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1787384825.133684:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1787384825.133696:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1787384825.133752:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203472000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384825.134123:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.134167:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e87e8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384825.134201:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203472000 00000100:00100000:3.0:1787384825.134327:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203472000 00000100:00100000:3.0:1787384825.134437:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787384825.134447:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+25:25032:x1874208203472000:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384825.134559:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+25:25032:x1874208203472000:12345-0@lo:502:mount.lustre.0 Request processed in 114us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384825.134635:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787384825.134699:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203472000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787384825.135163:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1787384825.135189:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1787384825.135285:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203472128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384825.135334:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.135424:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e87e8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384825.135444:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203472128 00000100:00100000:3.0:1787384825.135449:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203472128 00000100:00100000:3.0:1787384825.135475:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787384825.135482:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+25:25032:x1874208203472128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384825.135558:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+25:25032:x1874208203472128:12345-0@lo:502:mount.lustre.0 Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384825.135636:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787384825.135683:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203472128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787384825.135721:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1787384825.135729:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:0.0:1787384825.139805:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000020:01000004:2.0:1787384825.149576:0:25045:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787384825.149592:0:25045:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98f7c40319c0) 00000020:00000080:2.0:1787384825.149618:0:25045:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1787384825.149921:0:25045:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f5698000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787384825.149925:0:25045:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f5698000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787384825.149928:0:25045:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f5698000 3 00010000:00080000:2.0:1787384825.149957:0:25045:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f7c40e1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.145@tcp at head 00010000:00010000:2.0:1787384825.159261:0:25045:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1787384825.159366:0:25045:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787384825.159413:0:25045:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787384825.161452:0:25045:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7ef423838fba45f9 00000100:00080000:2.0:1787384825.161477:0:25045:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787384825.161483:0:25045:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f7c40e1800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384825.161521:0:25045:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f9149500 x1874208203472256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787384825.161554:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203472256:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787384825.161620:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.161693:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203472256 00000100:00100000:2.0:1787384825.161700:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203472256 00000100:00100000:2.0:1787384825.161741:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384825.161748:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874208203472256:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787384825.161772:0:22714:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 720 last 0 00000020:00000080:2.0:1787384825.161824:0:22714:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7ef423838fba4600 00000004:00100000:2.0:1787384825.161839:0:22714:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787384825.161869:0:22714:0:(import.c:65:import_set_state_nolock()) ffff98f8f87a5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384825.161917:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874208203472256:12345-0@lo:38:llog_process_th.0 Request processed in 167us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384825.161925:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787384825.161965:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f9149500 x1874208203472256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384825.161974:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384825.161981:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1787384825.161997:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787384825.162001:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787384825.162003:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c40e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787384825.162009:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203472256:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787384825.162039:0:25045:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787384825.162103:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384825.162107:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787384825.162109:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8d9b5c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384825.162113:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 718 00000100:00080000:2.0:1787384825.162116:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787384825.162120:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f8d9b5c800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384825.162133:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f9148000 x1874208203472640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384825.162195:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384825.162198:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787384825.162200:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384825.162203:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 718 00000100:00080000:2.0:1787384825.162206:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787384825.162209:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f943d000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384825.162221:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f9149f80 x1874208203473152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787384825.162259:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203472384:0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.162290:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.162311:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203473024:0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.162332:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.162350:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787384825.162355:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203472512:0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.162375:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.162398:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203473280:0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.162419:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.162443:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203472640:0@lo:8:kworker.0 00000100:00100000:2.0:1787384825.162462:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.162474:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203473152:0@lo:8:kworker.0 00000100:00100000:2.0:1787384825.162504:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.162528:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203472768:0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.162557:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.162572:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203473408:0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.162590:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.162603:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787384825.162608:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203472896:0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.162628:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.162645:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203473536:0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.162662:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.162682:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203472384 00000100:00100000:2.0:1787384825.162686:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203472384 00000100:00100000:2.0:1787384825.162709:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203472896 00000100:00100000:2.0:1787384825.162711:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203472896 00000100:00100000:2.0:1787384825.162724:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787384825.162730:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203472384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.162767:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203472384:12345-0@lo:400:kworker.0 Request processed in 37us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384825.162774:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787384825.162813:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384825.162819:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203472896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.162856:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203472896:12345-0@lo:400:kworker.0 Request processed in 37us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384825.162863:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384825.162880:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203473024 00000100:00100000:2.0:1787384825.162883:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203473024 00000100:00100000:2.0:1787384825.162907:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203472512 00000100:00100000:2.0:1787384825.162909:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203472512 00000100:00100000:2.0:1787384825.162919:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203472640 00000100:00100000:2.0:1787384825.162921:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203472640 00000100:00100000:2.0:1787384825.162929:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203473152 00000100:00100000:2.0:1787384825.162931:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203473152 00000100:00100000:2.0:1787384825.162939:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384825.162944:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203473024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.162971:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203473024:12345-0@lo:400:kworker.0 Request processed in 27us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384825.162978:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384825.162999:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787384825.163005:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203472512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.163029:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203472512:12345-0@lo:400:kworker.0 Request processed in 25us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384825.163034:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787384825.163044:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384825.163047:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874208203472640:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787384825.163081:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874208203472640:12345-0@lo:8:kworker.0 Request processed in 32us (618us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787384825.163087:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384825.163096:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384825.163100:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874208203473152:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787384825.163133:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874208203473152:12345-0@lo:8:kworker.0 Request processed in 32us (629us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787384825.163139:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384825.163157:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203473280 00000100:00100000:2.0:1787384825.163160:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203473280 00000100:00100000:2.0:1787384825.163175:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203472768 00000100:00100000:2.0:1787384825.163177:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203472768 00000100:00100000:2.0:1787384825.163186:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203473408 00000100:00100000:2.0:1787384825.163189:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203473408 00000100:00100000:2.0:1787384825.163200:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203473536 00000100:00100000:2.0:1787384825.163203:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203473536 00000100:00100000:2.0:1787384825.163214:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787384825.163219:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203473280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.163245:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203473280:12345-0@lo:400:kworker.0 Request processed in 26us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384825.163251:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787384825.163260:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787384825.163266:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203472768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.163286:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203472768:12345-0@lo:400:kworker.0 Request processed in 21us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384825.163292:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787384825.163302:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787384825.163307:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203473408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.163329:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203473408:12345-0@lo:400:kworker.0 Request processed in 22us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384825.163334:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787384825.163343:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787384825.163355:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203473536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.163379:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203473536:12345-0@lo:400:kworker.0 Request processed in 25us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384825.163384:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787384825.163440:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203472512:0@lo:400:kworker.0 00010000:00080000:2.0:1787384825.163451:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914ad80 x1874208203473280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384825.163463:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203473280:0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.163472:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203472384:0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.163479:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203473024:0@lo:400:kworker.0 00000100:00100000:2.0:1787384825.163510:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203472896:0@lo:400:kworker.0 00010000:00080000:2.0:1787384825.163518:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f91d9880 x1874208203473536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384825.163526:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203473536:0@lo:400:kworker.0 00010000:00080000:2.0:1787384825.163533:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f9149180 x1874208203472768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384825.163540:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203472768:0@lo:400:kworker.0 00010000:00080000:2.0:1787384825.163548:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914b100 x1874208203473408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384825.163556:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203473408:0@lo:400:kworker.0 00000100:00080000:2.0:1787384825.163590:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384825.163599:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384825.163601:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384825.163617:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384825.163622:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d9b5c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384825.163626:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787384825.163629:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203472640:0@lo:8:kworker.0 00000100:00100000:2.0:1787384825.163636:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384825.163639:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384825.163641:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787384825.163644:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203473152:0@lo:8:kworker.0 00000020:01000004:3.0:1787384825.168331:0:25045:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787384825.168351:0:25045:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98f8f91f19c0) 00000020:00000080:3.0:1787384825.168376:0:25045:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1787384825.168800:0:25045:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f5698000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787384825.168805:0:25045:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f5698000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787384825.168807:0:25045:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f5698000 3 00010000:00080000:3.0:1787384825.168836:0:25045:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f7c40e6800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384825.177888:0:25045:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1787384825.178022:0:25045:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787384825.178071:0:25045:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787384825.178092:0:25045:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x7ef423838fba460e 00000100:00080000:3.0:1787384825.178103:0:25045:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384825.178109:0:25045:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98f7c40e6800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384825.178166:0:25045:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f54f8380 x1874208203473664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384825.183201:0:25045:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787384825.183372:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874208203473664:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787384825.183461:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384825.184810:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203473664 00000100:00100000:2.0:1787384825.184822:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203473664 00000100:00100000:2.0:1787384825.184859:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384825.184868:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874208203473664:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787384825.184898:0:22712:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 720 last 0 00000020:00000080:2.0:1787384825.184930:0:22712:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x7ef423838fba4615 00000004:00100000:2.0:1787384825.184946:0:22712:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787384825.184981:0:22712:0:(import.c:65:import_set_state_nolock()) ffff98f8f87a1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384825.185060:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874208203473664:12345-0@lo:38:llog_process_th.0 Request processed in 191us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384825.185067:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1787384825.185572:0:25045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00010000:00080000:2.0:1787384825.186636:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f54f8380 x1874208203473664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384825.186649:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384825.186658:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1787384825.186666:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787384825.186687:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787384825.186690:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c40e6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787384825.186697:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874208203473664:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1787384825.187393:0:25032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787384825.187442:0:25032:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787384825.187467:0:25032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba45e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba45eb expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384825.187479:0:25032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba45e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba45eb expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787384825.187530:0:25032:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787384825.187532:0:25032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384825.187533:0:25032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384825.187535:0:25032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384825.187536:0:25032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384825.187537:0:25032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384825.187538:0:25032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384825.187543:0:25032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384825.187545:0:25032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787384825.187548:0:25032:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787384825.187551:0:25032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384825.187552:0:25032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384825.187553:0:25032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384825.187554:0:25032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384825.187555:0:25032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384825.187556:0:25032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384825.187557:0:25032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384825.187558:0:25032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384825.187559:0:25032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787384825.187578:0:25032:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787384825.187595:0:25032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203473792:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787384825.187654:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384825.187692:0:25032:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd4b7780 going to sleep for 11 seconds 00000100:00100000:3.0:1787384825.187712:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203473792 00000100:00100000:3.0:1787384825.187718:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203473792 00000100:00100000:3.0:1787384825.187765:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787384825.187773:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+24:25032:x1874208203473792:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787384825.187822:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787384825.187837:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787384825.209577:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787384825.209601:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787384825.210257:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+24:25032:x1874208203473792:12345-0@lo:253:mount.lustre.0 Request processed in 22480us (22597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384825.210270:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787384825.210363:0:25032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a654d8f2-2ab4-4025-870e-e3edf79de730:25032:1874208203473792:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787384825.210378:0:25032:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787384825.210382:0:25032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787384825.210384:0:25032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787384825.210386:0:25032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384825.210387:0:25032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787384825.210388:0:25032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384825.210389:0:25032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384825.210391:0:25032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787384825.210392:0:25032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384825.210394:0:25032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787384825.210409:0:25032:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787384825.211269:0:22729:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787384825.211276:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787384825.211295:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384825.211312:0:22729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2091c00/0x7ef423838fba44a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba44a2 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384825.211319:0:22729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba44b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba44b0 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384825.211327:0:22729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384825.211375:0:22729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba44b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba44b0 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384825.211388:0:22729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba44b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba44b0 expref: 23 pid: 22706 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384825.211401:0:22729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203473920:0@lo:104: 00000100:00100000:0.0:1787384825.212484:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384825.213559:0:22729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2091c00/0x7ef423838fba44a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba44a2 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.213574:0:22729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c2091c00/0x7ef423838fba44a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba44a2 expref: 23 pid: 22705 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384825.213587:0:22729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203474048:0@lo:104: 00000100:00100000:0.0:1787384825.213622:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:3.0:1787384825.215084:0:25032:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787384825.218748:0:25032:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787384825.218759:0:25032:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787384825.218826:0:25032:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787384825.218868:0:25032:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787384825.218885:0:25032:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787384825.218912:0:25032:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787384825.219901:0:25032:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:3.0:1787384825.230645:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203473920 00000100:00100000:3.0:1787384825.230656:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203473920 00000100:00100000:3.0:1787384825.230701:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203474048 00000100:00100000:3.0:1787384825.230704:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203474048 00000100:00100000:3.0:1787384825.230719:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787384825.230726:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+4:22729:x1874208203473920:12345-0@lo:104: 00010000:00010000:3.0:1787384825.230744:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba44b7 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384825.230833:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787384825.230839:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+4:22729:x1874208203473920:12345-0@lo:104: Request processed in 114us (18359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384825.230846:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787384825.230862:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384825.230867:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+3:22729:x1874208203474048:12345-0@lo:104: 00010000:00010000:3.0:1787384825.230874:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba44a9 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384825.230904:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787384825.230908:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+3:22729:x1874208203474048:12345-0@lo:104: Request processed in 42us (17288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384825.230914:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:00000004:3.0:1787384825.231002:0:25032:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787384825.240538:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384825.240550:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba44b7 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.240562:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091000 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384825.240566:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba44b7 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.240576:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba44b7 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384825.240593:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba44b7 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384825.240599:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384825.240650:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba44b7 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.240658:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384825.240678:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba44b7 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.240686:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba44b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba44b7 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.240698:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384825.240702:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba44a9 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.240708:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384825.240711:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba44a9 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.240718:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba44a9 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384825.240724:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba44a9 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384825.240729:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384825.240748:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba44a9 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.240754:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384825.240760:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba44a9 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.240767:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba44a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba44a9 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.240794:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384825.240796:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384825.240798:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384825.240804:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384825.240830:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203474176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384825.240892:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384825.240935:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384825.240941:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203474304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384825.240960:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384825.241003:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203474176 00000100:00100000:0.0:1787384825.241010:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203474176 00010000:00010000:0.0:1787384825.241034:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba44b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba44b0 expref: 24 pid: 22706 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384825.241057:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203474304 00000100:00100000:0.0:1787384825.241060:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203474304 00010000:00010000:0.0:1787384825.241070:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2091c00/0x7ef423838fba44a9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba44a2 expref: 25 pid: 22705 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384825.241083:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384825.241090:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+25:3651:x1874208203474176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384825.241109:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384825.243285:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba44b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba44b0 expref: 25 pid: 22706 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.243348:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba44b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba44b0 expref: 25 pid: 22706 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.243371:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384825.243444:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+25:3651:x1874208203474176:12345-0@lo:103:ldlm_bl.0 Request processed in 2352us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384825.243454:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384825.243487:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787384825.243496:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+24:3651:x1874208203474304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384825.243512:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384825.243516:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2091c00/0x7ef423838fba44a9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba44a2 expref: 24 pid: 22705 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.243526:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2091c00/0x7ef423838fba44a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba44a2 expref: 24 pid: 22705 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.243538:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.243546:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787384825.243561:0:22697:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.032285626s 00010000:00010000:0.0:1787384825.243565:0:22697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.243583:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.243590:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.243597:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.243603:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ae00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384825.243608:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.243616:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.243624:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.243633:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384825.243662:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+24:3651:x1874208203474304:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384825.243670:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787384825.243729:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203474304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384825.243739:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203474176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384825.243820:0:22729:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c4131600 going to sleep for 11 seconds 00010000:00010000:0.0:1787384825.244805:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba44b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba44b0 expref: 23 pid: 22706 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384825.244839:0:22729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203473920:0@lo:104: 00010000:00010000:0.0:1787384825.246754:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2091c00/0x7ef423838fba44a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba44a2 expref: 22 pid: 22705 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384825.246773:0:22729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22729:1874208203474048:0@lo:104: 00010000:00010000:0.0:1787384825.246835:0:22729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.246846:0:22729:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.246854:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384825.246860:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8d965ae00/0x7ef423838fba461c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384825.718937:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787384826.201913:0:25099:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384826.202430:0:25099:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1787384826.680224:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787384826.680231:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8efb5a800 from 14 10000000:01000000:0.0:1787384826.680236:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787384826.680284:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04c00/0x7ef423838fba4623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384826.680294:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04c00/0x7ef423838fba4623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384826.680304:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04c00/0x7ef423838fba4623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384826.680344:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203474432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384826.680413:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384826.680460:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384826.680557:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203474432 00000100:00100000:1.0:1787384826.680564:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203474432 00000100:00100000:1.0:1787384826.680615:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787384826.680624:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+22:22709:x1874208203474432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384826.680637:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384826.680651:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba462a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba4623 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384826.681237:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba462a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba4623 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384826.681248:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba462a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4623 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384826.681257:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ba00, rc 0) 00000100:00100000:1.0:1787384826.681337:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+23:22709:x1874208203474432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 714us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384826.681345:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787384826.681399:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203474432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384826.681414:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04c00/0x7ef423838fba4623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba462a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384826.681434:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04c00/0x7ef423838fba4623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba462a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384826.681493:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203474560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787384826.681526:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384826.681553:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d931d780 going to sleep for 11 seconds 00000100:00100000:1.0:1787384826.681568:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203474560 00000100:00100000:1.0:1787384826.681573:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203474560 00000100:00100000:1.0:1787384826.681600:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787384826.681606:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+23:22709:x1874208203474560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787384826.681621:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787384826.681636:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787384826.681639:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787384826.683042:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+23:22709:x1874208203474560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1430us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384826.683054:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787384826.687640:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203474560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787384826.688189:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787384826.688201:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04c00/0x7ef423838fba4623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba462a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384826.688212:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04c00/0x7ef423838fba4623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba462a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384826.688221:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787384826.688224:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f0fb9000 from 14 10000000:01000000:0.0:1787384826.688227:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787384826.688257:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05400/0x7ef423838fba4631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384826.688266:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05400/0x7ef423838fba4631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384826.688275:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05400/0x7ef423838fba4631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384826.688295:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203474688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384826.688349:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384826.688632:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384826.692011:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203474688 00000100:00100000:1.0:1787384826.692026:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203474688 00000100:00100000:1.0:1787384826.692123:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787384826.692133:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+23:22709:x1874208203474688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384826.692150:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384826.692167:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965b800/0x7ef423838fba4638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba4631 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384826.692192:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965b800/0x7ef423838fba4638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba4631 expref: 24 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384826.692216:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965b800/0x7ef423838fba4638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4631 expref: 24 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384826.692226:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b800, rc 0) 00000100:00100000:1.0:1787384826.692307:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+24:22709:x1874208203474688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (3958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384826.692315:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787384826.692389:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203474688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384826.692405:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05400/0x7ef423838fba4631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba4638 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384826.692425:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05400/0x7ef423838fba4631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba4638 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384826.692486:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203474816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787384826.692523:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384826.697925:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc33bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384826.698114:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203474816 00000100:00100000:0.0:1787384826.698132:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203474816 00000100:00100000:0.0:1787384826.698431:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787384826.698442:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+24:22709:x1874208203474816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787384826.698467:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787384826.700036:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787384826.700043:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1787384826.700220:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203474816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787384826.700289:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787384826.700299:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05400/0x7ef423838fba4631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba4638 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384826.700310:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05400/0x7ef423838fba4631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba4638 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384826.702150:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+24:22709:x1874208203474816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 3700us (9616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384826.702166:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00010000:1.0:1787384826.750829:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384827.319889:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203474944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384827.319958:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384827.320031:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203474944 00000100:00100000:2.0:1787384827.320039:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203474944 00000100:00100000:2.0:1787384827.320087:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384827.320096:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203474944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384827.320122:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787384827.320163:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203474944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384827.320170:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787384827.320189:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384827.320242:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203474944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384827.320394:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384827.320403:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203475072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384827.320433:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384827.320538:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203475072 00000100:00100000:3.0:1787384827.320543:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203475072 00000100:00100000:3.0:1787384827.320593:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384827.320599:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203475072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384827.320609:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787384827.320640:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203475072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384827.320646:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787384827.320817:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384827.320841:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203475072:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787384827.768223:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384828.343459:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384828.343483:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203475200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384828.343561:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384828.343617:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203475200 00000100:00100000:0.0:1787384828.343628:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203475200 00000100:00100000:0.0:1787384828.343687:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787384828.343696:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203475200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787384828.343730:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787384828.343806:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203475200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384828.343814:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787384828.343845:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203475328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384828.343892:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384828.343931:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203475328 00000100:00100000:1.0:1787384828.343937:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203475328 00000100:00100000:0.0:1787384828.343942:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203475200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384828.343989:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787384828.343995:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787384828.344000:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203475328:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384828.344005:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:1.0:1787384828.344024:0:22718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384828.344062:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203475328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384828.344069:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787384828.344096:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203475328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787384828.798045:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384829.815320:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787384830.328644:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787384830.392640:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203475456:0@lo:400:kworker.0 00000100:00100000:2.0:1787384830.392715:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384830.392859:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203475456 00000100:00100000:3.0:1787384830.392867:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203475456 00000100:00100000:3.0:1787384830.392914:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787384830.392934:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+24:3653:x1874208203475456:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787384830.396140:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384830.396146:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787384830.396150:0:36:0:(import.c:65:import_set_state_nolock()) ffff98f8d9b5c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384830.396161:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f8d9b5c800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384830.396171:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384830.396187:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203475712:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.396261:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.396308:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203475712 00000100:00100000:1.0:1787384830.396316:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203475712 00000100:00100000:1.0:1787384830.396367:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787384830.396376:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203475712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.396424:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203475712:12345-0@lo:400:kworker.0 Request processed in 49us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384830.396431:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787384830.396449:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384830.396476:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203475712:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.396513:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c2a02d80 x1874208203475840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384830.396537:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203475840:0@lo:8:kworker.0 00000100:00100000:1.0:1787384830.396560:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.396587:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203475840 00000100:00100000:1.0:1787384830.396590:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203475840 00000100:00100000:1.0:1787384830.396608:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384830.396613:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874208203475840:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787384830.396640:0:24221:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:1.0:1787384830.396668:0:24221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba463f 00002000:00100000:1.0:1787384830.396683:0:24221:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98f7c40e3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787384830.396687:0:24221:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787384830.396690:0:24221:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787384830.396871:0:24221:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787384830.396892:0:24221:0:(import.c:65:import_set_state_nolock()) ffff98f7c40e7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384830.397247:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+24:3653:x1874208203475456:12345-0@lo:400:kworker.0 Request processed in 4312us (4529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384830.397258:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787384830.397298:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203475584:0@lo:400:kworker.0 00000100:00100000:3.0:1787384830.397334:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.398252:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1874208203475840:12345-0@lo:8:kworker.0 Request processed in 1635us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384830.398270:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384830.398303:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203475584 00000100:00100000:1.0:1787384830.398309:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203475584 00000100:00100000:1.0:1787384830.398346:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787384830.398353:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203475584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.398408:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203475584:12345-0@lo:400:kworker.0 Request processed in 55us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384830.398414:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787384830.398449:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203475584:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.398503:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203475968:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.398532:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.398565:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203475968 00000100:00100000:1.0:1787384830.398569:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203475968 00000100:00100000:1.0:1787384830.398596:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384830.398602:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203475968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.398634:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203475968:12345-0@lo:400:kworker.0 Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384830.398641:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787384830.398667:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a01880 x1874208203475968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384830.398677:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203475968:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.398703:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384830.398708:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203476096:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.398732:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.398765:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203476096 00000100:00100000:1.0:1787384830.398769:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203476096 00000100:00100000:1.0:1787384830.398806:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787384830.398812:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203476096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.398843:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203476096:12345-0@lo:400:kworker.0 Request processed in 31us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384830.398849:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787384830.398870:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203476096:0@lo:400:kworker.0 00000100:00080000:1.0:1787384830.398892:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384830.398896:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787384830.398899:0:36:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384830.398906:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f943d000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384830.398912:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203476224:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.400174:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.400235:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203476224 00000100:00100000:1.0:1787384830.400241:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203476224 00000100:00100000:1.0:1787384830.400283:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384830.400291:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203476224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.400337:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203476224:12345-0@lo:400:kworker.0 Request processed in 46us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384830.400344:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787384830.400364:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384830.400388:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203476224:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.400425:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8ee115500 x1874208203476352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384830.400463:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203476480:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.400498:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.400529:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203476480 00000100:00100000:1.0:1787384830.400533:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203476480 00000100:00100000:1.0:1787384830.400555:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787384830.400561:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203476480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.400593:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203476480:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384830.400599:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787384830.400624:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee115c00 x1874208203476480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384830.400634:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203476480:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.400662:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203476608:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.400689:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.400711:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203476608 00000100:00100000:1.0:1787384830.400715:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203476608 00000100:00100000:1.0:1787384830.400737:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787384830.400743:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203476608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.400773:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203476608:12345-0@lo:400:kworker.0 Request processed in 29us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384830.400798:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787384830.400811:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787384830.400826:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee115c00 x1874208203476608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384830.400836:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203476608:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.400861:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384830.400874:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203476736:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.400899:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.400917:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203476736 00000100:00100000:2.0:1787384830.401360:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203475456:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.405083:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203476736 00000100:00100000:1.0:1787384830.405157:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787384830.405169:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203476736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.405256:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203476736:12345-0@lo:400:kworker.0 Request processed in 90us (4355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384830.405264:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787384830.405289:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787384830.405324:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee115c00 x1874208203476736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384830.405340:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203476736:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.405402:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203476864:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.405436:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.405468:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203476864 00000100:00100000:1.0:1787384830.405471:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203476864 00000100:00100000:1.0:1787384830.405496:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384830.405502:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203476864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.405532:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203476864:12345-0@lo:400:kworker.0 Request processed in 30us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384830.405539:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787384830.405550:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787384830.405565:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422c700 x1874208203476864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384830.405575:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203476864:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.405617:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203476992:0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.405647:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.405675:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203476992 00000100:00100000:1.0:1787384830.405679:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203476992 00000100:00100000:1.0:1787384830.405703:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787384830.405709:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203476992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384830.405755:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203476992:12345-0@lo:400:kworker.0 Request processed in 45us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384830.405761:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787384830.405794:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787384830.405813:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422c700 x1874208203476992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384830.405822:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203476992:0@lo:400:kworker.0 00010000:00080000:3.0:1787384830.408092:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a02d80 x1874208203475840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787384830.408125:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787384830.408135:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787384830.408141:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787384830.408145:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d9b5c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787384830.408163:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787384830.408170:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203475840:0@lo:8:kworker.0 00000100:00100000:3.0:1787384830.408200:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203476352:0@lo:8:kworker.0 00000100:00100000:3.0:1787384830.408256:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787384830.408331:0:22740:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1787384830.408349:0:22740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22740:1874208203477248:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787384830.408371:0:22740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384830.408385:0:22740:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc33b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384830.408403:0:24638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203476352 00000100:00100000:3.0:1787384830.408408:0:24638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203476352 00000100:00100000:3.0:1787384830.408436:0:24638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203477248 00000100:00100000:3.0:1787384830.408439:0:24638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203477248 00000100:00100000:3.0:1787384830.408483:0:24638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384830.408492:0:24638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3650:x1874208203476352:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787384830.408521:0:24638:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:3.0:1787384830.408564:0:24638:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba4646 00002000:00100000:3.0:1787384830.408577:0:24638:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff98f8f87a1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787384830.408582:0:24638:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787384830.408585:0:24638:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787384830.408651:0:24638:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787384830.408675:0:24638:0:(import.c:65:import_set_state_nolock()) ffff98f8f943f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384830.408717:0:24638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1874208203476352:12345-0@lo:8:kworker.0 Request processed in 225us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384830.408726:0:24638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384830.408743:0:24638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787384830.408750:0:24638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22740:x1874208203477248:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787384830.409178:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203477120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384830.409209:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384830.409242:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203477120 00000100:00100000:3.0:1787384830.409285:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203477120 00000100:00100000:3.0:1787384830.409315:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384830.409321:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874208203477120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384830.409338:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787384830.409373:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874208203477120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384830.409380:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:0.0:1787384830.410041:0:22739:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787384830.410218:0:22739:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725490438291ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787384830.410225:0:22739:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:2.0:1787384830.413185:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee115500 x1874208203476352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384830.413208:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787384830.413217:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787384830.413223:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787384830.413226:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787384830.413242:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787384830.413249:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203476352:0@lo:8:kworker.0 00000004:00080000:2.0:1787384830.413311:0:23457:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787384830.413329:0:23457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1874208203477504:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787384830.413386:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384830.413410:0:23457:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d82bca80 going to sleep for 11 seconds 00000004:00080000:2.0:1787384830.413426:0:23456:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787384830.413603:0:23456:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 725493823864ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787384830.413610:0:23456:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:2.0:1787384830.413645:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787384830.413704:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f54f8e00 x1874208203477120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384830.413721:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203477120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384830.413750:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203477504 00000100:00100000:2.0:1787384830.413763:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203477504 00000100:00100000:2.0:1787384830.413918:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787384830.413927:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23457:x1874208203477504:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1787384830.414048:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203477376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384830.414091:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787384830.414358:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384830.414388:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203477376 00000100:00100000:2.0:1787384830.414393:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203477376 00000100:00100000:2.0:1787384830.414418:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384830.414425:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1874208203477376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384830.414439:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787384830.414898:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1874208203477376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 471us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384830.414916:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787384830.415151:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7e69880 x1874208203477376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384830.415173:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203477376:0@lo:13:osp-pre-1-1.0 00002000:00080000:3.0:1787384830.416329:0:24638:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787384830.416340:0:24638:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1787384830.416346:0:24638:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:0.0:1787384830.416450:0:24218:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787384830.416456:0:24218:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787384830.416557:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23457:x1874208203477504:12345-0@lo:7:osp-pre-1-1.0 Request processed in 2629us (3167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384830.416568:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787384830.416616:0:23457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7e6b100 x1874208203477504/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787384846 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384830.416629:0:23457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1874208203477504:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787384830.416651:0:23457:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787384830.416689:0:23457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1874208203477632:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787384830.416722:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.416750:0:23457:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c4d6ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384830.416751:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203477632 00000100:00100000:2.0:1787384830.416760:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203477632 00000004:00080000:1.0:1787384830.416805:0:23445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787384830.416939:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787384830.416949:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23457:x1874208203477632:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787384830.416982:0:24220:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1787384830.417016:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23457:x1874208203477632:12345-0@lo:5:osp-pre-1-1.0 Request processed in 69us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384830.417022:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787384830.417183:0:23457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422fb80 x1874208203477632/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384846 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384830.417193:0:23457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1874208203477632:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787384830.417203:0:23457:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787384830.417229:0:23457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1874208203477760:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787384830.417252:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384830.417267:0:23457:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c4d6ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384830.417278:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203477760 00000100:00100000:1.0:1787384830.417281:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203477760 00000100:00100000:1.0:1787384830.417304:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384830.417313:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23457:x1874208203477760:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787384830.417338:0:24218:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:1.0:1787384830.421080:0:22692:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787384830.431305:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.431317:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba464d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.431339:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.431343:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.431350:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba464d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.431368:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba464d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.431380:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba464d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.431389:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba464d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.431410:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384830.431422:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384830.431428:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba464d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.431436:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384830.431440:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba464d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.431449:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba464d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.431478:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba464d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.431487:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba464d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.431504:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.431507:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.431509:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.434204:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.434218:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba4654 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.434233:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.434238:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.434245:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba4654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.434258:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba4654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.434267:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba4654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.434275:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba4654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.434309:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384830.434333:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384830.434342:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba4654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.434352:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824a00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384830.434357:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba4654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.434379:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba4654 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.434399:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba4654 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.434406:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba4654 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.434426:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.434428:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.434430:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.436197:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.436209:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba465b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.436224:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.436228:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.436233:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba465b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.436245:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba465b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.436254:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba465b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.436262:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba465b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.436281:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384830.436291:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384830.436297:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba465b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.436305:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825a00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384830.436317:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba465b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.436326:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba465b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.436341:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba465b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.436348:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba465b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.436364:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.436366:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.436369:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.438031:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.438042:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba4662 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.438058:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.438063:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.438069:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba4662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.438083:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba4662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.438092:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba4662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.438107:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba4662 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.438129:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384830.438140:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384830.438146:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba4662 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.438153:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384830.438158:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba4662 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.438167:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba4662 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.438183:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba4662 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.438190:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba4662 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.438208:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.438210:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.438212:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787384830.438647:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384830.438656:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba4669 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.438666:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1787384830.438670:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384830.438674:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba4669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.438685:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba4669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.438693:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba4669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.438707:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba4669 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.438734:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384830.438872:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384830.438879:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba4669 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.438887:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ae00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384830.438890:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba4669 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.438899:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba4669 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.438915:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba4669 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.439105:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba4669 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.439123:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.439130:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.439132:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.439276:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.439290:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba4670 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.439300:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.439304:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.439308:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba4670 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.439320:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba4670 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.439328:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba4670 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.439335:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba4670 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.439357:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384830.439416:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384830.439422:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba4670 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.439431:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384830.439435:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba4670 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.439444:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba4670 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.439456:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba4670 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.439463:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba4670 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.439481:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.439483:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.439485:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.439665:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.439672:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba4677 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.439680:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.439683:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.439687:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba4677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.439696:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba4677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.439711:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba4677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.439719:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba4677 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.439738:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384830.440026:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384830.440032:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba4677 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.440041:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384830.440044:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba4677 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.440053:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba4677 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.440066:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba4677 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.440073:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba4677 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.440087:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.440089:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.440092:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.440453:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.440460:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba467e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.440469:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.440473:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.440478:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba467e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.440487:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba467e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.440495:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba467e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.440501:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba467e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.440568:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384830.440693:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384830.440705:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba467e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.440712:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384830.440716:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba467e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.440724:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba467e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.440737:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba467e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.440744:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba467e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.440760:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.440762:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.440763:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.444152:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.444164:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba4685 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.444183:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.444187:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.444194:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba4685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.444208:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba4685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.444218:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba4685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.444225:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba4685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.444259:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384830.444275:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384830.444281:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba4685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.444289:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384830.444302:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba4685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.444311:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba4685 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.444329:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba4685 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.444336:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba4685 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.444353:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.444355:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.444357:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787384830.447381:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384830.447393:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c0188bb/0x7ef423838fba468c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.447411:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1787384830.447416:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384830.447423:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c0188bb/0x7ef423838fba468c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.447450:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c0188bb/0x7ef423838fba468c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.447460:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c0188bb/0x7ef423838fba468c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.447468:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c0188bb/0x7ef423838fba468c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.447491:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384830.447566:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384830.447572:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c0188bb/0x7ef423838fba468c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.447581:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384830.447586:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c0188bb/0x7ef423838fba468c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.447595:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c0188bb/0x7ef423838fba468c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.447611:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c0188bb/0x7ef423838fba468c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.447625:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c0188bb/0x7ef423838fba468c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.447644:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.447646:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.447647:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787384830.448224:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384830.448231:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a9d9c86/0x7ef423838fba4693 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.448251:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1787384830.448255:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384830.448260:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a9d9c86/0x7ef423838fba4693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.448270:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a9d9c86/0x7ef423838fba4693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.448278:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a9d9c86/0x7ef423838fba4693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.448297:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a9d9c86/0x7ef423838fba4693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.448313:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384830.448589:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384830.448596:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a9d9c86/0x7ef423838fba4693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.448604:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384830.448607:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a9d9c86/0x7ef423838fba4693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.448615:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a9d9c86/0x7ef423838fba4693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.448627:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a9d9c86/0x7ef423838fba4693 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.448633:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a9d9c86/0x7ef423838fba4693 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.448647:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.448649:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.448651:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.453045:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.453060:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba469a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453087:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.453092:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.453099:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba469a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453114:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba469a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453124:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba469a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453131:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba469a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453151:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384830.453361:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384830.453368:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba469a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453377:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384830.453381:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba469a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453403:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba469a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453419:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba469a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453426:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba469a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453449:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.453452:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.453455:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.453874:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.453880:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba46a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453890:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.453894:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.453898:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba46a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453908:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba46a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453916:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba46a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453941:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba46a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.453963:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384830.454065:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384830.454073:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba46a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.454082:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825a00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384830.454086:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba46a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.454102:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba46a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.454115:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba46a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.454123:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8506a94/0x7ef423838fba46a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.454141:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.454143:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.454144:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.454372:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.454378:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db3ef4af/0x7ef423838fba46a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.454387:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.454391:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.454395:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db3ef4af/0x7ef423838fba46a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.454405:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db3ef4af/0x7ef423838fba46a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.454413:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db3ef4af/0x7ef423838fba46a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.454421:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db3ef4af/0x7ef423838fba46a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.454435:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384830.454513:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384830.454519:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db3ef4af/0x7ef423838fba46a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.454527:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384830.454531:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db3ef4af/0x7ef423838fba46a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.454538:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db3ef4af/0x7ef423838fba46a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.454549:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db3ef4af/0x7ef423838fba46a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.454555:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db3ef4af/0x7ef423838fba46a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.454568:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.454570:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.454571:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787384830.454917:0:25033:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1787384830.454942:0:25033:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787384830.454947:0:25033:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787384830.455204:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23457:x1874208203477760:12345-0@lo:5:osp-pre-1-1.0 Request processed in 37888us (37945us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787384830.455213:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787384830.455259:0:23457:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787384830.455267:0:23457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1874208203477760:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787384830.455281:0:23457:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1787384830.455330:0:23457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23457:1874208203477888:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1787384830.455343:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.455351:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcb87e85/0x7ef423838fba46af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.455368:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=725s v=(0 0) 00000100:00100000:0.0:1787384830.455369:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384830.455375:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.455380:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb87e85/0x7ef423838fba46af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.455392:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcb87e85/0x7ef423838fba46af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384830.455395:0:23457:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829a000 going to sleep for 11 seconds 00010000:00010000:3.0:1787384830.455402:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcb87e85/0x7ef423838fba46af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.455413:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb87e85/0x7ef423838fba46af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384830.455426:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203477888 00010000:00010000:3.0:1787384830.455431:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787384830.455434:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203477888 00010000:00010000:3.0:1787384830.455442:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384830.455448:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcb87e85/0x7ef423838fba46af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.455456:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384830.455461:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcb87e85/0x7ef423838fba46af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.455469:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcb87e85/0x7ef423838fba46af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384830.455476:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384830.455489:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23457:x1874208203477888:12345-0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1787384830.455508:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcb87e85/0x7ef423838fba46af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.455516:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcb87e85/0x7ef423838fba46af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.455535:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.455538:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.455540:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384830.455547:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23457:x1874208203477888:12345-0@lo:900:osp-pre-1-1.0 Request processed in 61us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384830.455555:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787384830.455590:0:23457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee146300 x1874208203477888/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787384846 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384830.455600:0:23457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23457:1874208203477888:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1787384830.455894:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.455900:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba46b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.455910:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.455913:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.455928:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba46b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.455938:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba46b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.455946:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba46b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.455961:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba46b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.455987:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787384830.456351:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.456358:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba46bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456367:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.456370:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.456374:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba46bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456383:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba46bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456391:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba46bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456399:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba46bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456410:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787384830.456417:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384830.456422:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba46b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456429:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384830.456439:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba46b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456447:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba46b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456459:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba46b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456466:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ded9c5a8/0x7ef423838fba46b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456479:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384830.456482:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba46bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456489:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384830.456492:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba46bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456500:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba46bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456508:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba46bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456515:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c22068f3/0x7ef423838fba46bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456532:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.456533:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.456535:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.456677:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.456900:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.456906:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba46c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.456915:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.456986:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.456991:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba46c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457002:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba46c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457010:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba46c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457017:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba46c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457035:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384830.457061:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384830.457068:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba46c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.457077:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384830.457080:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba46c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.457089:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba46c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.457102:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba46c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.457110:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8a700e7/0x7ef423838fba46c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.457133:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.457135:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.457137:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.457416:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.457422:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba46cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457441:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.457443:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.457448:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba46cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457457:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba46cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457465:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba46cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457472:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba46cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457489:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787384830.457702:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.457708:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba46d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457715:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.457718:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.457723:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba46d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457731:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba46d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457749:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba46d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457756:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba46d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.457768:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787384830.457823:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384830.457829:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba46cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.457837:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384830.457840:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba46cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.457848:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba46cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.457859:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba46cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.457935:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000922a4ea/0x7ef423838fba46cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.458019:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384830.458023:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba46d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.458030:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824a00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384830.458040:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba46d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.458048:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba46d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384830.458055:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384830.458060:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba46d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.458063:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000401bbf6/0x7ef423838fba46d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.458076:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000402a9842/0x7ef423838fba46d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.458090:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.458092:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.458093:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.458127:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.458130:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.458134:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000401bbf6/0x7ef423838fba46d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.458144:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000401bbf6/0x7ef423838fba46d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.458149:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.458152:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000401bbf6/0x7ef423838fba46d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.458425:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000401bbf6/0x7ef423838fba46d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.458471:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384830.458655:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384830.458666:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000401bbf6/0x7ef423838fba46d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.458674:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384830.458678:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000401bbf6/0x7ef423838fba46d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.458686:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000401bbf6/0x7ef423838fba46d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.458698:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000401bbf6/0x7ef423838fba46d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.458705:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000401bbf6/0x7ef423838fba46d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.458720:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.458721:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.458723:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384830.459042:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384830.459049:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000397e1cf3/0x7ef423838fba46e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.459058:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=725s v=(0 0) 00010000:00010000:2.0:1787384830.459061:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384830.459071:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000397e1cf3/0x7ef423838fba46e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.459083:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000397e1cf3/0x7ef423838fba46e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.459091:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000397e1cf3/0x7ef423838fba46e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.459097:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000397e1cf3/0x7ef423838fba46e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.459121:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384830.459145:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384830.459152:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000397e1cf3/0x7ef423838fba46e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.459362:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384830.459366:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000397e1cf3/0x7ef423838fba46e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.459376:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000397e1cf3/0x7ef423838fba46e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.459388:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000397e1cf3/0x7ef423838fba46e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.459396:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000397e1cf3/0x7ef423838fba46e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.459412:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.459414:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.459416:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384830.461896:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.461909:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba46e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.461925:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.461937:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.461942:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba46e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.461967:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba46e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.461978:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba46e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.461986:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba46e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.462051:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384830.462422:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384830.462433:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba46e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.462441:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384830.462445:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba46e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.462466:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba46e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.462482:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba46e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.462489:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c862755f/0x7ef423838fba46e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384830.462496:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.462501:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe722f5c/0x7ef423838fba46ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.462507:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.462508:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=725s v=(0 0) 00010000:00010000:1.0:1787384830.462509:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.462511:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384830.462511:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384830.462516:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe722f5c/0x7ef423838fba46ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.462524:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe722f5c/0x7ef423838fba46ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.462532:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe722f5c/0x7ef423838fba46ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.462543:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe722f5c/0x7ef423838fba46ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.462559:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787384830.462857:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.462862:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f37484b5/0x7ef423838fba46f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.462870:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.462873:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.462877:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f37484b5/0x7ef423838fba46f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.462887:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f37484b5/0x7ef423838fba46f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.462894:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f37484b5/0x7ef423838fba46f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.462902:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f37484b5/0x7ef423838fba46f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.462914:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787384830.463364:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384830.463372:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094982267/0x7ef423838fba46fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.463388:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=725s v=(0 0) 00010000:00010000:3.0:1787384830.463391:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384830.463395:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094982267/0x7ef423838fba46fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.463406:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094982267/0x7ef423838fba46fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.463413:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094982267/0x7ef423838fba46fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.463422:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094982267/0x7ef423838fba46fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384830.463432:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787384830.463754:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787384830.463762:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe722f5c/0x7ef423838fba46ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.463772:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384830.463806:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe722f5c/0x7ef423838fba46ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.463817:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe722f5c/0x7ef423838fba46ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.463833:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe722f5c/0x7ef423838fba46ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.463852:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe722f5c/0x7ef423838fba46ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.463880:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384830.463884:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f37484b5/0x7ef423838fba46f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.463890:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384830.463893:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f37484b5/0x7ef423838fba46f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.463900:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f37484b5/0x7ef423838fba46f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.463911:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f37484b5/0x7ef423838fba46f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.463918:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f37484b5/0x7ef423838fba46f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.463931:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384830.463934:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094982267/0x7ef423838fba46fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.463940:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384830.464022:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094982267/0x7ef423838fba46fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.464032:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094982267/0x7ef423838fba46fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.464043:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094982267/0x7ef423838fba46fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.464049:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094982267/0x7ef423838fba46fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384830.464063:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384830.464065:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384830.464067:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384830.464712:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384830.464722:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba4703 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.464734:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1787384830.464738:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384830.464743:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba4703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.464755:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba4703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.464764:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba4703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.464801:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba4703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.464822:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787384830.465631:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384830.465638:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba470a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.465648:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1787384830.465652:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384830.465656:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba470a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.465664:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba470a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.465671:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba470a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.465677:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba470a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.465686:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787384830.466420:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384830.466429:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bed7f74/0x7ef423838fba4711 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.466447:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1787384830.466450:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384830.466455:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bed7f74/0x7ef423838fba4711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.466463:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bed7f74/0x7ef423838fba4711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.466472:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bed7f74/0x7ef423838fba4711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.466479:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bed7f74/0x7ef423838fba4711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.466488:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787384830.466627:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787384830.466635:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba4703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466644:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384830.466649:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba4703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466658:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba4703 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466673:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba4703 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466693:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba4703 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466714:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384830.466718:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba470a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466724:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384830.466727:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba470a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466735:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba470a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466746:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba470a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466752:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba470a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384830.466761:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384830.466765:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384830.466768:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000035dc138/0x7ef423838fba4718 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466770:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bed7f74/0x7ef423838fba4711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466807:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384830.466817:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bed7f74/0x7ef423838fba4711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466824:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bed7f74/0x7ef423838fba4711 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466834:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bed7f74/0x7ef423838fba4711 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466840:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bed7f74/0x7ef423838fba4711 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.466851:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.466853:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.466854:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.467359:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1787384830.467363:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384830.467368:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000035dc138/0x7ef423838fba4718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.467379:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000035dc138/0x7ef423838fba4718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.467401:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000035dc138/0x7ef423838fba4718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.467407:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000035dc138/0x7ef423838fba4718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.467470:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787384830.468009:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384830.468016:0:24638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba471f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.468026:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=725s v=(0 0) 00010000:00010000:0.0:1787384830.468029:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384830.468033:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba471f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.468043:0:24638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba471f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.468049:0:24638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba471f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384830.468056:0:24638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba471f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.468267:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384830.468274:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000035dc138/0x7ef423838fba4718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.468282:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05a00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384830.468286:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000035dc138/0x7ef423838fba4718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.468294:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000035dc138/0x7ef423838fba4718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.468307:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000035dc138/0x7ef423838fba4718 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.468323:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000035dc138/0x7ef423838fba4718 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.468340:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384830.468344:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba471f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.468350:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384830.468352:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba471f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.468359:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba471f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.468368:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba471f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384830.468374:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.468375:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384830.468377:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384830.468478:0:24638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787384830.468483:0:24638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba471f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787384830.468540:0:24638:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1787384830.468627:0:24638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22740:x1874208203477248:12345-0@lo:5:osp-pre-1-0.0 Request processed in 59873us (60251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384830.468637:0:24638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787384830.468697:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384830.469080:0:22740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22740:1874208203477248:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787384830.469096:0:22740:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1787384830.469139:0:22740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22740:1874208203478016:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787384830.469188:0:22740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384830.469212:0:22740:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384830.469231:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203478016 00010000:00010000:3.0:1787384830.469248:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384830.469348:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203478016 00000100:00100000:1.0:1787384830.469396:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384830.469406:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22740:x1874208203478016:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787384830.469441:0:24221:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1787384830.475438:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22740:x1874208203478016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6026us (6241us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787384830.475451:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787384830.475533:0:22740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22740:1874208203478016:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787384830.475549:0:22740:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1787384830.841332:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787384831.647384:0:25390:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787384831.873381:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384832.442668:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384832.442689:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203478144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384832.442766:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384832.442836:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203478144 00000100:00100000:3.0:1787384832.442844:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203478144 00000100:00100000:3.0:1787384832.442911:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787384832.442922:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203478144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384832.442961:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787384832.443003:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203478144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384832.443011:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787384832.443034:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384832.443067:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203478144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384832.448205:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203478272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384832.448275:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384832.448361:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203478272 00000100:00100000:3.0:1787384832.448369:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203478272 00000100:00100000:3.0:1787384832.448432:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384832.448441:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203478272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384832.448463:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787384832.448507:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203478272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384832.448514:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384832.448566:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203478272:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787384832.450861:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:0.0:1787384832.545372:0:25442:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787384832.545653:0:25442:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787384832.893300:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384833.464047:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203478400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384833.464093:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203478528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384833.464122:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384833.464217:0:25210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203478400 00000100:00100000:2.0:1787384833.464225:0:25210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203478400 00000100:00100000:2.0:1787384833.464271:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787384833.464280:0:25210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203478400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384833.464312:0:25210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787384833.464613:0:25210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203478400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 332us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384833.464629:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787384833.464681:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203478400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384833.465708:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384833.465856:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203478528 00000100:00100000:2.0:1787384833.465863:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203478528 00000100:00100000:2.0:1787384833.466513:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787384833.466526:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203478528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384833.466569:0:22718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787384833.466644:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203478528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384833.466651:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787384833.469036:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203478528:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1787384833.575623:0:25492:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787384833.576190:0:25492:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787384833.911123:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384833.918888:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384833.919032:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182391296 00000100:00100000:1.0:1787384833.919042:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182391296 00000100:00100000:1.0:1787384833.919097:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 116 00000100:00100000:1.0:1787384833.919105:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2412:x1874208182391296:12345-192.168.203.45@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787384833.919132:0:22707:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 9d482831-3a49-488a-9a1d-d55fc29705fa@192.168.203.45@tcp t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:1.0:1787384833.919160:0:22707:0:(genops.c:1406:class_connect()) connect: client 9d482831-3a49-488a-9a1d-d55fc29705fa, cookie 0x7ef423838fba4726 00000100:00080000:1.0:1787384833.919283:0:22707:0:(import.c:65:import_set_state_nolock()) ffff98f7c40e7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384833.919356:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+5:2412:x1874208182391296:12345-192.168.203.45@tcp:250:mount.lustre.0 Request processed in 250us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384833.919364:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 116 00000100:00100000:0.0:1787384833.933177:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384833.933315:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182391424 00000100:00100000:3.0:1787384833.933325:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182391424 00000100:00100000:3.0:1787384833.933394:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 117 00000100:00100000:3.0:1787384833.933404:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+5:18129:x1874208182391424:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384833.933430:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384833.933449:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5825400/0x7ef423838fba472d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3cd4 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384833.933590:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5825400/0x7ef423838fba472d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3cd4 expref: 6 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384833.933603:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5825400/0x7ef423838fba472d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3cd4 expref: 6 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384833.933611:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5825400, rc 0) 00000100:00100000:3.0:1787384833.933774:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+6:18129:x1874208182391424:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 371us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384833.933803:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 117 00000100:00100000:2.0:1787384833.943668:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384833.943940:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182391552 00000100:00100000:3.0:1787384833.943950:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182391552 00000100:00100000:3.0:1787384833.944712:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 118 00000100:00100000:3.0:1787384833.944727:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+6:18129:x1874208182391552:12345-192.168.203.45@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787384833.944876:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+6:18129:x1874208182391552:12345-192.168.203.45@tcp:501:mount.lustre.0 Request processed in 154us (1216us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384833.944885:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 118 00000100:00100000:2.0:1787384833.950032:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384833.950633:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182391680 00000100:00100000:3.0:1787384833.950642:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182391680 00000100:00100000:3.0:1787384833.950700:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 119 00000100:00100000:3.0:1787384833.950710:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+6:18129:x1874208182391680:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384833.950726:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384833.950743:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5824600/0x7ef423838fba4734 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3cdb expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384833.950771:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5824600/0x7ef423838fba4734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3cdb expref: 7 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384833.950819:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5824600/0x7ef423838fba4734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3cdb expref: 7 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384833.950827:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5824600, rc 0) 00000100:00100000:3.0:1787384833.950994:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+7:18129:x1874208182391680:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 284us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384833.951002:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 119 00000100:00100000:0.0:1787384833.953638:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384833.953724:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182391808 00000100:00100000:3.0:1787384833.953734:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182391808 00000100:00100000:3.0:1787384833.953809:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 120 00000100:00100000:3.0:1787384833.953819:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+7:18129:x1874208182391808:12345-192.168.203.45@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787384833.954270:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+8:18129:x1874208182391808:12345-192.168.203.45@tcp:501:mount.lustre.0 Request processed in 450us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384833.954278:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 120 00000100:00100000:2.0:1787384833.961122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384833.961225:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182391936 00000100:00100000:1.0:1787384833.961235:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182391936 00000100:00100000:1.0:1787384833.961415:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 121 00000100:00100000:1.0:1787384833.961425:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+8:18129:x1874208182391936:12345-192.168.203.45@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787384833.961562:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+8:18129:x1874208182391936:12345-192.168.203.45@tcp:503:mount.lustre.0 Request processed in 138us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384833.961570:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 121 00000100:00100000:2.0:1787384833.974920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384833.975315:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182392064 00000100:00100000:3.0:1787384833.975326:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182392064 00000100:00100000:3.0:1787384833.975385:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 122 00000100:00100000:3.0:1787384833.975395:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+8:18147:x1874208182392064:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384833.975584:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+8:18147:x1874208182392064:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 189us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384833.975592:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 122 00000100:00100000:2.0:1787384834.008729:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384834.009242:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182392192 00000100:00100000:0.0:1787384834.009253:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182392192 00000100:00100000:0.0:1787384834.009348:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 123 00000100:00100000:0.0:1787384834.009359:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+8:18147:x1874208182392192:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384834.009516:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+8:18147:x1874208182392192:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 157us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384834.009530:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 123 00000100:00100000:0.0:1787384834.017034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384834.017103:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182392320 00000100:00100000:3.0:1787384834.017114:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182392320 00000100:00100000:3.0:1787384834.017182:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 124 00000100:00100000:3.0:1787384834.017193:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+8:18147:x1874208182392320:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384834.017396:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+8:18147:x1874208182392320:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 204us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384834.017406:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 124 00000100:00100000:2.0:1787384834.035011:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384834.035364:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182392448 00000100:00100000:0.0:1787384834.035375:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182392448 00000100:00100000:0.0:1787384834.035487:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 125 00000100:00100000:0.0:1787384834.035499:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+8:18129:x1874208182392448:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787384834.035514:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384834.035531:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba473b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3d0c expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384834.035559:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba473b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d0c expref: 9 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384834.035570:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b05000/0x7ef423838fba473b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d0c expref: 9 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384834.035578:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05000, rc 0) 00000100:00100000:0.0:1787384834.035639:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+9:18129:x1874208182392448:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 142us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384834.035646:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 125 00000100:00100000:2.0:1787384834.047505:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384834.047601:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182392576 00000100:00100000:1.0:1787384834.047611:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182392576 00000100:00100000:1.0:1787384834.047671:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 126 00000100:00100000:1.0:1787384834.047680:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+9:18129:x1874208182392576:12345-192.168.203.45@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787384834.047720:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787384834.047737:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787384834.047742:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787384834.047745:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787384834.047748:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787384834.047751:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787384834.053587:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+9:18129:x1874208182392576:12345-192.168.203.45@tcp:256:mount.lustre.0 Request processed in 5896us (6079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384834.053602:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 126 00000100:00100000:2.0:1787384834.056166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384834.056348:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182392704 00000100:00100000:0.0:1787384834.056360:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182392704 00000100:00100000:0.0:1787384834.056414:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 127 00000100:00100000:0.0:1787384834.056747:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+9:18129:x1874208182392704:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787384834.056765:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384834.056818:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba4742 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3d13 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384834.056863:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba4742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d13 expref: 10 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384834.056992:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba4742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d13 expref: 10 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384834.057004:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04600, rc 0) 00000100:00100000:0.0:1787384834.057319:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+10:18129:x1874208182392704:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 895us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384834.057327:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 127 00000100:00100000:2.0:1787384834.068289:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384834.068815:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182392832 00000100:00100000:1.0:1787384834.068826:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182392832 00000100:00100000:1.0:1787384834.068896:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 128 00000100:00100000:1.0:1787384834.068911:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+10:18129:x1874208182392832:12345-192.168.203.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787384834.069361:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+10:18129:x1874208182392832:12345-192.168.203.45@tcp:501:mount.lustre.0 Request processed in 454us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384834.069369:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 128 00000100:00100000:2.0:1787384834.071453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384834.071550:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182392960 00000100:00100000:0.0:1787384834.071558:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182392960 00000100:00100000:0.0:1787384834.071609:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 129 00000100:00100000:0.0:1787384834.071619:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+10:18129:x1874208182392960:12345-192.168.203.45@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787384834.071765:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+10:18129:x1874208182392960:12345-192.168.203.45@tcp:503:mount.lustre.0 Request processed in 146us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384834.071773:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 129 00000100:00100000:2.0:1787384834.079106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384834.079312:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182393088 00000100:00100000:1.0:1787384834.079321:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182393088 00000100:00100000:1.0:1787384834.079379:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 130 00000100:00100000:1.0:1787384834.079390:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+10:18152:x1874208182393088:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787384834.079545:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+10:18152:x1874208182393088:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 156us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384834.079553:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 130 00000100:00100000:2.0:1787384834.082528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384834.082616:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182393216 00000100:00100000:3.0:1787384834.082625:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182393216 00000100:00100000:3.0:1787384834.082733:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 131 00000100:00100000:3.0:1787384834.082746:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+10:18152:x1874208182393216:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384834.083305:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+10:18152:x1874208182393216:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 560us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384834.083316:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 131 00000100:00100000:2.0:1787384834.106207:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384834.106252:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384834.106547:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182393344 00000100:00100000:1.0:1787384834.106557:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182393344 00000100:00100000:1.0:1787384834.106606:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182393600 00000100:00100000:1.0:1787384834.106616:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182393600 00000100:00100000:1.0:1787384834.106638:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:1.0:1787384834.106647:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2412:x1874208182393344:12345-192.168.203.45@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787384834.106677:0:22714:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 348c65a2-a652-4219-ac42-befa509a5d50@192.168.203.45@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:1.0:1787384834.106735:0:22714:0:(genops.c:1406:class_connect()) connect: client 348c65a2-a652-4219-ac42-befa509a5d50, cookie 0x7ef423838fba4749 00000004:00100000:1.0:1787384834.106760:0:22714:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1787384834.107196:0:22714:0:(import.c:65:import_set_state_nolock()) ffff98f7c40e2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384834.107282:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+6:2412:x1874208182393344:12345-192.168.203.45@tcp:38:mount.lustre.0 Request processed in 635us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384834.107292:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:1.0:1787384834.107311:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:1.0:1787384834.107316:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2412:x1874208182393600:12345-192.168.203.45@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787384834.107334:0:22714:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 348c65a2-a652-4219-ac42-befa509a5d50@192.168.203.45@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:1.0:1787384834.107374:0:22714:0:(genops.c:1406:class_connect()) connect: client 348c65a2-a652-4219-ac42-befa509a5d50, cookie 0x7ef423838fba4750 00000004:00100000:1.0:1787384834.107390:0:22714:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1787384834.107524:0:22714:0:(import.c:65:import_set_state_nolock()) ffff98f8f7dfe000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384834.107551:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+6:2412:x1874208182393600:12345-192.168.203.45@tcp:38:mount.lustre.0 Request processed in 233us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384834.107558:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:2.0:1787384834.112613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384834.112653:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384834.112737:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182393472 00000100:00100000:0.0:1787384834.112747:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182393472 00000100:00100000:3.0:1787384834.112954:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182393728 00000100:00100000:3.0:1787384834.112959:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182393728 00000100:00100000:3.0:1787384834.112986:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:3.0:1787384834.112996:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:0:x1874208182393472:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787384834.113037:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787384834.113141:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:0:x1874208182393472:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 146us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384834.113149:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:3.0:1787384834.113168:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:3.0:1787384834.113174:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:0:x1874208182393728:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787384834.113192:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787384834.113225:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:0:x1874208182393728:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 51us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384834.113231:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:0.0:1787384834.113733:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00080000:2.0:1787384834.113811:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384834.113816:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384834.114001:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182393856 00000100:00100000:3.0:1787384834.114005:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182393856 00000100:00100000:3.0:1787384834.114042:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:3.0:1787384834.114062:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:18129:x1874208182393856:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787384834.114079:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787384834.114181:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:18129:x1874208182393856:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 132us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384834.114189:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:3.0:1787384834.123460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384834.123576:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182393984 00000100:00100000:1.0:1787384834.123585:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182393984 00000100:00100000:1.0:1787384834.123640:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:1.0:1787384834.123648:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:18129:x1874208182393984:12345-192.168.203.45@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787384834.123997:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:18129:x1874208182393984:12345-192.168.203.45@tcp:40:mount.lustre.0 Request processed in 348us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384834.124020:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:3.0:1787384834.147854:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384834.148583:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182394112 00000100:00100000:0.0:1787384834.148594:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182394112 00000100:00100000:0.0:1787384834.148646:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:0.0:1787384834.148655:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2412:x1874208182394112:12345-192.168.203.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787384834.148690:0:24218:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 348c65a2-a652-4219-ac42-befa509a5d50@192.168.203.45@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:0.0:1787384834.148736:0:24218:0:(genops.c:1406:class_connect()) connect: client 348c65a2-a652-4219-ac42-befa509a5d50, cookie 0x7ef423838fba4757 00002000:00100000:0.0:1787384834.148749:0:24218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 348c65a2-a652-4219-ac42-befa509a5d50/ffff98f8c896e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787384834.148766:0:24218:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1787384834.148982:0:24218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787384834.149016:0:24218:0:(import.c:65:import_set_state_nolock()) ffff98f8c896b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384834.149092:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:348c65a2-a652-4219-ac42-befa509a5d50+6:2412:x1874208182394112:12345-192.168.203.45@tcp:8:mount.lustre.0 Request processed in 437us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384834.149100:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:1.0:1787384834.153246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384834.153330:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182394240 00000100:00100000:3.0:1787384834.153341:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182394240 00000100:00100000:3.0:1787384834.153385:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:3.0:1787384834.153399:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2412:x1874208182394240:12345-192.168.203.45@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787384834.153434:0:24220:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 348c65a2-a652-4219-ac42-befa509a5d50@192.168.203.45@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:3.0:1787384834.153464:0:24220:0:(genops.c:1406:class_connect()) connect: client 348c65a2-a652-4219-ac42-befa509a5d50, cookie 0x7ef423838fba475e 00002000:00100000:3.0:1787384834.153476:0:24220:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 348c65a2-a652-4219-ac42-befa509a5d50/ffff98f8ef637800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787384834.153493:0:24220:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1787384834.153935:0:24220:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787384834.153967:0:24220:0:(import.c:65:import_set_state_nolock()) ffff98f8ef633800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384834.154073:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:2412:x1874208182394240:12345-192.168.203.45@tcp:8:mount.lustre.0 Request processed in 678us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384834.154082:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:2.0:1787384834.164128:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384834.164556:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182394368 00000100:00100000:3.0:1787384834.164566:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182394368 00000100:00100000:3.0:1787384834.164630:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:3.0:1787384834.164654:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:348c65a2-a652-4219-ac42-befa509a5d50+6:18129:x1874208182394368:12345-192.168.203.45@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787384834.164757:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:348c65a2-a652-4219-ac42-befa509a5d50+6:18129:x1874208182394368:12345-192.168.203.45@tcp:900:mount.lustre.0 Request processed in 106us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384834.164766:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:0.0:1787384834.168064:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384834.168160:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182394496 00000100:00100000:2.0:1787384834.168168:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182394496 00000100:00100000:2.0:1787384834.168220:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:2.0:1787384834.168229:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+6:18129:x1874208182394496:12345-192.168.203.45@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787384834.169097:0:22715:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 787us 00000004:00200000:3.0:1787384834.184314:0:22715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787384834.184449:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+6:18129:x1874208182394496:12345-192.168.203.45@tcp:33:mount.lustre.0 Request processed in 16215us (16388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384834.184479:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:2.0:1787384834.366012:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384834.366121:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182394624 00000100:00100000:1.0:1787384834.366132:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182394624 00000100:00100000:1.0:1787384834.366191:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 13 00000100:00100000:1.0:1787384834.366201:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+6:18175:x1874208182394624:12345-192.168.203.45@tcp:101:mkdir.0 00010000:00010000:1.0:1787384834.366221:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384834.366246:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba4765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3d44 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384834.366308:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba476c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384834.366322:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba476c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384834.366338:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba476c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384834.366399:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787384834.366403:0:22714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384834.366468:0:22714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba476c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384834.366496:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba4765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d44 expref: 8 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384834.366513:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba476c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d44 expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384834.366532:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384834.366535:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384834.366538:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ae00, rc 0) 00000100:00100000:1.0:1787384834.366596:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+7:18175:x1874208182394624:12345-192.168.203.45@tcp:101:mkdir.0 Request processed in 397us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384834.366603:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 13 00000040:00080000:1.0:1787384834.423367:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787384834.935055:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384835.511097:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203478784:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.511173:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.511222:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203479296:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.511243:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.511261:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203479808:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.511283:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.511303:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787384835.511309:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203478912:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.511329:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.511343:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203479424:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.511358:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.511370:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203479936:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.511389:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.511416:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203478784 00000100:00100000:1.0:1787384835.511423:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203478784 00000100:00100000:1.0:1787384835.511461:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203479296 00000100:00100000:1.0:1787384835.511477:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203479296 00000100:00100000:1.0:1787384835.511500:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787384835.511507:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203478784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.511558:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203478784:12345-0@lo:400:kworker.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384835.511565:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787384835.511583:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787384835.511589:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203479296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384835.511728:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384835.511738:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203480320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384835.511766:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384835.511833:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203479808 00000100:00100000:2.0:1787384835.511837:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203479808 00000100:00100000:2.0:1787384835.511870:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203479936 00000100:00100000:2.0:1787384835.511873:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203479936 00000100:00100000:2.0:1787384835.511888:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787384835.511894:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203479808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384835.511937:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203479808:12345-0@lo:400:kworker.0 Request processed in 44us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384835.511944:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787384835.511956:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384835.511963:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203479936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384835.511988:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203479936:12345-0@lo:400:kworker.0 Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384835.511994:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787384835.512019:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384835.512023:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787384835.512060:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422fb80 x1874208203479936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384835.512072:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203479936:0@lo:400:kworker.0 00000100:00100000:2.0:1787384835.512083:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203478784:0@lo:400:kworker.0 00000100:00100000:2.0:1787384835.512093:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203479808:0@lo:400:kworker.0 00000100:00100000:3.0:1787384835.512241:0:24638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203478912 00000100:00100000:3.0:1787384835.512245:0:24638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203478912 00000100:00100000:3.0:1787384835.512280:0:24638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203479424 00000100:00100000:3.0:1787384835.512283:0:24638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203479424 00000100:00100000:3.0:1787384835.512305:0:24638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787384835.512311:0:24638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203478912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.512458:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203479296:12345-0@lo:400:kworker.0 Request processed in 868us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384835.512466:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787384835.512502:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203479040:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.512530:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.512543:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203479552:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.512562:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.512573:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203480064:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.512594:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.512623:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787384835.512629:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203478656:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.512655:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.512678:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203479168:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.512698:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.512715:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203479680:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.512734:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.512745:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203480192:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.512775:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384835.512819:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203479040 00000100:00100000:1.0:1787384835.512822:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203479040 00000100:00100000:1.0:1787384835.512842:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203479552 00000100:00100000:1.0:1787384835.512844:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203479552 00000100:00100000:1.0:1787384835.512858:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787384835.512865:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203479424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384835.516287:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203480448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384835.516381:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384835.516445:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203480320 00000100:00100000:0.0:1787384835.516453:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203480320 00000100:00100000:0.0:1787384835.516486:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203480448 00000100:00100000:0.0:1787384835.516489:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203480448 00000100:00100000:0.0:1787384835.516504:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384835.516512:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3652:x1874208203480320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384835.516535:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787384835.516551:0:24638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203478912:12345-0@lo:400:kworker.0 Request processed in 4238us (5218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384835.516560:0:24638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384835.516572:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3652:x1874208203480320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (4805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384835.516577:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787384835.516581:0:24638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384835.516588:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787384835.516589:0:24638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3653:x1874208203479040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384835.516593:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874208203480448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384835.516600:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787384835.516632:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874208203480448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384835.516644:0:24638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3653:x1874208203479040:12345-0@lo:400:kworker.0 Request processed in 58us (4114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384835.516646:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787384835.516651:0:24638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787384835.516662:0:24638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384835.516664:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203480064 00000100:00100000:3.0:1787384835.516667:0:24638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203479552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384835.516668:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203480064 00000100:00100000:0.0:1787384835.516688:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203479168 00000100:00100000:0.0:1787384835.516690:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203479168 00000100:00100000:0.0:1787384835.516701:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203479680 00000100:00100000:3.0:1787384835.516702:0:24638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203479552:12345-0@lo:400:kworker.0 Request processed in 35us (4140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384835.516704:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203479680 00000100:00100000:3.0:1787384835.516708:0:24638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384835.516714:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203480192 00000100:00100000:0.0:1787384835.516717:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203480192 00000100:00080000:3.0:1787384835.516731:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384835.516732:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787384835.516734:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384835.516737:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384835.516737:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203480064:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787384835.516740:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384835.516765:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203480064:12345-0@lo:400:kworker.0 Request processed in 29us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384835.516771:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787384835.516797:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787384835.516803:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203479168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384835.516808:0:22713:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787384835.516816:0:22713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787384835.516829:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203479168:12345-0@lo:400:kworker.0 Request processed in 26us (4130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384835.516830:0:22714:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787384835.516834:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384835.516837:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787384835.516843:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203479680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384835.516843:0:22712:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787384835.516847:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787384835.516852:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203480192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384835.516875:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203480192:12345-0@lo:400:kworker.0 Request processed in 22us (4098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384835.516880:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787384835.516882:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203479680:12345-0@lo:400:kworker.0 Request processed in 39us (4147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384835.516887:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787384835.516906:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203478656 00000100:00100000:3.0:1787384835.516910:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203478656 00000100:00100000:3.0:1787384835.516946:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787384835.516952:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+24:3653:x1874208203478656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384835.516990:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+24:3653:x1874208203478656:12345-0@lo:400:kworker.0 Request processed in 38us (4334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384835.516995:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787384835.516997:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203480448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384835.517012:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203480320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384835.517493:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203478656:0@lo:400:kworker.0 00000100:00100000:3.0:1787384835.517507:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203479168:0@lo:400:kworker.0 00000100:00100000:3.0:1787384835.517517:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203479680:0@lo:400:kworker.0 00010000:00080000:3.0:1787384835.517529:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee115c00 x1874208203480192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384835.517546:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203480192:0@lo:400:kworker.0 00000100:00100000:3.0:1787384835.517558:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203479040:0@lo:400:kworker.0 00000100:00100000:3.0:1787384835.517566:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203479552:0@lo:400:kworker.0 00000100:00100000:3.0:1787384835.517579:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203480064:0@lo:400:kworker.0 00000100:00100000:2.0:1787384835.520563:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203479296:0@lo:400:kworker.0 00000100:00100000:1.0:1787384835.520563:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203479424:12345-0@lo:400:kworker.0 Request processed in 7694us (9198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384835.520583:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384835.520610:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203478912:0@lo:400:kworker.0 00000100:00100000:2.0:1787384835.520624:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203479424:0@lo:400:kworker.0 00010000:00010000:2.0:1787384835.959350:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787384836.031470:0:25033:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 348c65a2-a652-4219-ac42-befa509a5d50 00000001:00080000:0.0:1787384836.031486:0:25033:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:1.0:1787384836.431929:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384836.432051:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182394752 00000100:00100000:0.0:1787384836.432062:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182394752 00000100:00100000:0.0:1787384836.432150:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00100000:0.0:1787384836.432162:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+7:18227:x1874208182394752:12345-192.168.203.45@tcp:41:lfs.0 00000100:00080000:3.0:1787384836.432212:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1787384836.432347:0:22712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787384836.432448:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+7:18227:x1874208182394752:12345-192.168.203.45@tcp:41:lfs.0 Request processed in 288us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384836.432455:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00100000:2.0:1787384836.436741:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.436852:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182394880 00000100:00100000:3.0:1787384836.436862:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182394880 00000100:00100000:3.0:1787384836.436949:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:3.0:1787384836.436959:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:18227:x1874208182394880:12345-192.168.203.45@tcp:41:lfs.0 00000004:00000024:3.0:1787384836.436997:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787384836.437095:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:18227:x1874208182394880:12345-192.168.203.45@tcp:41:lfs.0 Request processed in 138us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.437104:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00080000:2.0:1787384836.437494:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384836.442370:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384836.443655:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182395008 00000100:00100000:0.0:1787384836.443668:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182395008 00000100:00100000:0.0:1787384836.443747:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:0.0:1787384836.443767:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:348c65a2-a652-4219-ac42-befa509a5d50+6:18227:x1874208182395008:12345-192.168.203.45@tcp:13:lfs.0 00002000:00000024:0.0:1787384836.443826:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384836.443924:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:348c65a2-a652-4219-ac42-befa509a5d50+6:18227:x1874208182395008:12345-192.168.203.45@tcp:13:lfs.0 Request processed in 159us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384836.443934:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00080000:2.0:1787384836.444000:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384836.447336:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384836.447882:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182395136 00000100:00100000:0.0:1787384836.447892:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182395136 00000100:00100000:0.0:1787384836.448013:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:0.0:1787384836.448026:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:348c65a2-a652-4219-ac42-befa509a5d50+5:18227:x1874208182395136:12345-192.168.203.45@tcp:13:lfs.0 00002000:00000024:0.0:1787384836.448068:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787384836.448151:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:348c65a2-a652-4219-ac42-befa509a5d50+5:18227:x1874208182395136:12345-192.168.203.45@tcp:13:lfs.0 Request processed in 128us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384836.448173:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00080000:2.0:1787384836.448840:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384836.707619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.707773:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182395264 00000100:00100000:3.0:1787384836.707805:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182395264 00000100:00100000:3.0:1787384836.707863:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 133 00000100:00100000:3.0:1787384836.707872:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+10:18259:x1874208182395264:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384836.707888:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384836.707904:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5824800/0x7ef423838fba4773 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3d4b expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384836.707940:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5824800/0x7ef423838fba4773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d4b expref: 11 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384836.707968:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5824800/0x7ef423838fba4773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d4b expref: 11 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384836.707977:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5824800, rc 0) 00000100:00100000:3.0:1787384836.708969:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18259:x1874208182395264:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 1090us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.708979:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 133 00000100:00100000:1.0:1787384836.727708:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.727805:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182395392 00000100:00100000:3.0:1787384836.727815:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182395392 00000100:00100000:3.0:1787384836.727881:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 134 00000100:00100000:3.0:1787384836.727892:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18259:x1874208182395392:12345-192.168.203.45@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787384836.728206:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18259:x1874208182395392:12345-192.168.203.45@tcp:501:mount.lustre.0 Request processed in 315us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.728215:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 134 00000100:00100000:2.0:1787384836.733376:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.733460:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182395520 00000100:00100000:3.0:1787384836.733469:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182395520 00000100:00100000:3.0:1787384836.733528:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 135 00000100:00100000:3.0:1787384836.733537:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18259:x1874208182395520:12345-192.168.203.45@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787384836.733695:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18259:x1874208182395520:12345-192.168.203.45@tcp:503:mount.lustre.0 Request processed in 158us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.733703:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 135 00000100:00100000:1.0:1787384836.740542:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.740767:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182395648 00000100:00100000:3.0:1787384836.740802:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182395648 00000100:00100000:3.0:1787384836.740868:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 136 00000100:00100000:3.0:1787384836.740878:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18265:x1874208182395648:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384836.741047:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18265:x1874208182395648:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 170us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.741056:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 136 00000100:00100000:2.0:1787384836.794287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384836.794439:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182395776 00000100:00100000:1.0:1787384836.794449:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182395776 00000100:00100000:1.0:1787384836.794503:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 137 00000100:00100000:1.0:1787384836.794513:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18265:x1874208182395776:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787384836.794677:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18265:x1874208182395776:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 164us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384836.794686:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 137 00000100:00100000:2.0:1787384836.802874:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384836.802976:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182395904 00000100:00100000:1.0:1787384836.802986:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182395904 00000100:00100000:1.0:1787384836.803043:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 138 00000100:00100000:1.0:1787384836.803052:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18265:x1874208182395904:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787384836.803202:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18265:x1874208182395904:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 149us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384836.803216:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 138 00000100:00100000:2.0:1787384836.824483:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.824557:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182396032 00000100:00100000:3.0:1787384836.824566:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182396032 00000100:00100000:3.0:1787384836.824618:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 139 00000100:00100000:3.0:1787384836.824627:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18259:x1874208182396032:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384836.824641:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384836.824657:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5824000/0x7ef423838fba477a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3d7c expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384836.824683:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5824000/0x7ef423838fba477a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d7c expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384836.824695:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5824000/0x7ef423838fba477a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d7c expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384836.824703:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5824000, rc 0) 00000100:00100000:3.0:1787384836.824759:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+12:18259:x1874208182396032:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 133us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.824766:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 139 00000100:00100000:2.0:1787384836.831089:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.831219:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182396160 00000100:00100000:3.0:1787384836.831230:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182396160 00000100:00100000:3.0:1787384836.831299:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 140 00000100:00100000:3.0:1787384836.831310:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+12:18259:x1874208182396160:12345-192.168.203.45@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787384836.831335:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787384836.831363:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787384836.831367:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787384836.831370:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787384836.831373:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787384836.831376:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1787384836.840534:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+12:18259:x1874208182396160:12345-192.168.203.45@tcp:256:mount.lustre.0 Request processed in 9215us (9442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.840548:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 140 00000100:00100000:2.0:1787384836.846027:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384836.846399:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182396288 00000100:00100000:1.0:1787384836.846410:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182396288 00000100:00100000:1.0:1787384836.846509:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 141 00000100:00100000:1.0:1787384836.846520:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+12:18259:x1874208182396288:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787384836.846536:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384836.846554:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965a200/0x7ef423838fba4781 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3d83 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384836.846583:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965a200/0x7ef423838fba4781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d83 expref: 13 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384836.846595:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965a200/0x7ef423838fba4781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d83 expref: 13 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384836.846604:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a200, rc 0) 00000100:00100000:1.0:1787384836.846671:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18259:x1874208182396288:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 152us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384836.846679:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 141 00000100:00100000:3.0:1787384836.849064:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384836.849291:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182396416 00000100:00100000:0.0:1787384836.849301:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182396416 00000100:00100000:0.0:1787384836.849355:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 142 00000100:00100000:0.0:1787384836.849364:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18259:x1874208182396416:12345-192.168.203.45@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787384836.849499:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18259:x1874208182396416:12345-192.168.203.45@tcp:501:mount.lustre.0 Request processed in 136us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384836.849506:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 142 00000100:00100000:2.0:1787384836.851770:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384836.852031:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182396544 00000100:00100000:1.0:1787384836.852040:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182396544 00000100:00100000:1.0:1787384836.852133:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 143 00000100:00100000:1.0:1787384836.852145:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18259:x1874208182396544:12345-192.168.203.45@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787384836.852294:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18259:x1874208182396544:12345-192.168.203.45@tcp:503:mount.lustre.0 Request processed in 151us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384836.852301:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 143 00000100:00100000:2.0:1787384836.855412:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.855742:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182396672 00000100:00100000:3.0:1787384836.855753:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182396672 00000100:00100000:3.0:1787384836.855830:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 144 00000100:00100000:3.0:1787384836.855841:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18269:x1874208182396672:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384836.856419:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18269:x1874208182396672:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 578us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.856431:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 144 00000100:00100000:2.0:1787384836.860140:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384836.861658:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182396800 00000100:00100000:1.0:1787384836.861671:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182396800 00000100:00100000:1.0:1787384836.861736:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 145 00000100:00100000:1.0:1787384836.861749:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18269:x1874208182396800:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787384836.861928:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18269:x1874208182396800:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 180us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384836.861937:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 145 00000100:00100000:2.0:1787384836.873078:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384836.873118:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384836.873151:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384836.873187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384836.873218:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182397824 00000100:00100000:2.0:1787384836.873227:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182397824 00000100:00100000:2.0:1787384836.873282:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182397952 00000100:00100000:2.0:1787384836.873286:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182397952 00000100:00100000:2.0:1787384836.873309:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:2.0:1787384836.873318:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:2416:x1874208182397824:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384836.873385:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:2416:x1874208182397824:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 68us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384836.873392:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:2.0:1787384836.873407:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:2.0:1787384836.873413:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:2416:x1874208182397952:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384836.873435:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:2416:x1874208182397952:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 23us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384836.873441:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:1.0:1787384836.873558:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182397568 00000100:00100000:1.0:1787384836.873564:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182397568 00000100:00100000:1.0:1787384836.873591:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182397696 00000100:00100000:1.0:1787384836.873594:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182397696 00000100:00100000:1.0:1787384836.873612:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:1.0:1787384836.873619:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+7:2416:x1874208182397568:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384836.873651:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+7:2416:x1874208182397568:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 32us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384836.873658:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:1.0:1787384836.873671:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 44 00000100:00100000:1.0:1787384836.873678:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+6:2416:x1874208182397696:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384836.873701:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+6:2416:x1874208182397696:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384836.873706:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 44 00000100:00100000:3.0:1787384836.876004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.876093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.876124:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182396928 00000100:00100000:3.0:1787384836.876135:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182396928 00000100:00100000:3.0:1787384836.876169:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182397184 00000100:00100000:3.0:1787384836.876171:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182397184 00000100:00100000:3.0:1787384836.876192:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:3.0:1787384836.876199:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2412:x1874208182396928:12345-192.168.203.45@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787384836.876228:0:22714:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 84891948-9b25-4376-8d8c-2664f1d91fdc@192.168.203.45@tcp t0 exp 0000000000000000 cur 731 last 0 00000020:00000080:3.0:1787384836.876278:0:22714:0:(genops.c:1406:class_connect()) connect: client 84891948-9b25-4376-8d8c-2664f1d91fdc, cookie 0x7ef423838fba4788 00000004:00100000:3.0:1787384836.876303:0:22714:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1787384836.876409:0:22714:0:(import.c:65:import_set_state_nolock()) ffff98f8ef635800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384836.876649:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+6:2412:x1874208182396928:12345-192.168.203.45@tcp:38:mount.lustre.0 Request processed in 447us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.876657:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:3.0:1787384836.876679:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:3.0:1787384836.876684:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2412:x1874208182397184:12345-192.168.203.45@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787384836.876700:0:22714:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 84891948-9b25-4376-8d8c-2664f1d91fdc@192.168.203.45@tcp t0 exp 0000000000000000 cur 731 last 0 00000020:00000080:3.0:1787384836.876724:0:22714:0:(genops.c:1406:class_connect()) connect: client 84891948-9b25-4376-8d8c-2664f1d91fdc, cookie 0x7ef423838fba478f 00000004:00100000:3.0:1787384836.876738:0:22714:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1787384836.876818:0:22714:0:(import.c:65:import_set_state_nolock()) ffff98f8ef636000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384836.876846:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+6:2412:x1874208182397184:12345-192.168.203.45@tcp:38:mount.lustre.0 Request processed in 160us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.876852:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:2.0:1787384836.886140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.886226:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182397440 00000100:00100000:3.0:1787384836.886238:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182397440 00000100:00100000:3.0:1787384836.886347:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:3.0:1787384836.886362:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+6:18259:x1874208182397440:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787384836.886400:0:22714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787384836.886669:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+6:18259:x1874208182397440:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 310us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.886679:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00080000:2.0:1787384836.886798:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384836.890880:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384836.890934:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384836.891153:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182397056 00000100:00100000:2.0:1787384836.891164:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182397056 00000100:00100000:2.0:1787384836.891222:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182397312 00000100:00100000:2.0:1787384836.891225:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182397312 00000100:00100000:2.0:1787384836.891275:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:2.0:1787384836.891285:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84891948-9b25-4376-8d8c-2664f1d91fdc+6:0:x1874208182397056:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787384836.891317:0:25506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787384836.891399:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84891948-9b25-4376-8d8c-2664f1d91fdc+6:0:x1874208182397056:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 115us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384836.891407:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:3.0:1787384836.891625:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:3.0:1787384836.891636:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+6:0:x1874208182397312:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787384836.891652:0:22714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787384836.891681:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+6:0:x1874208182397312:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 48us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.891695:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00080000:1.0:1787384836.892430:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384836.905162:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.905429:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182398080 00000100:00100000:3.0:1787384836.905440:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182398080 00000100:00100000:3.0:1787384836.905500:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:3.0:1787384836.905510:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+6:18259:x1874208182398080:12345-192.168.203.45@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787384836.905598:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+6:18259:x1874208182398080:12345-192.168.203.45@tcp:40:mount.lustre.0 Request processed in 89us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.905605:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:2.0:1787384836.913096:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384836.913136:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384836.913174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384836.913256:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182398464 00000100:00100000:3.0:1787384836.913274:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182398464 00000100:00100000:3.0:1787384836.913335:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:3.0:1787384836.913344:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:84891948-9b25-4376-8d8c-2664f1d91fdc+6:18259:x1874208182398464:12345-192.168.203.45@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787384836.913421:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:84891948-9b25-4376-8d8c-2664f1d91fdc+6:18259:x1874208182398464:12345-192.168.203.45@tcp:900:mount.lustre.0 Request processed in 77us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384836.913429:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:0.0:1787384836.913683:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182398208 00000100:00100000:0.0:1787384836.913688:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182398208 00000100:00100000:0.0:1787384836.913718:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182398336 00000100:00100000:0.0:1787384836.913721:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182398336 00000100:00100000:0.0:1787384836.913743:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:0.0:1787384836.913749:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2412:x1874208182398208:12345-192.168.203.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787384836.913776:0:24220:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 84891948-9b25-4376-8d8c-2664f1d91fdc@192.168.203.45@tcp t0 exp 0000000000000000 cur 731 last 0 00000020:00000080:0.0:1787384836.913844:0:24220:0:(genops.c:1406:class_connect()) connect: client 84891948-9b25-4376-8d8c-2664f1d91fdc, cookie 0x7ef423838fba4796 00002000:00100000:0.0:1787384836.913856:0:24220:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 84891948-9b25-4376-8d8c-2664f1d91fdc/ffff98f8d9698800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787384836.913866:0:24220:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1787384836.913953:0:24220:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787384836.913983:0:24220:0:(import.c:65:import_set_state_nolock()) ffff98f8f4b9e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384836.914023:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+6:2412:x1874208182398208:12345-192.168.203.45@tcp:8:mount.lustre.0 Request processed in 273us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384836.914031:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:0.0:1787384836.914047:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:0.0:1787384836.914051:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2412:x1874208182398336:12345-192.168.203.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787384836.914086:0:24220:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 84891948-9b25-4376-8d8c-2664f1d91fdc@192.168.203.45@tcp t0 exp 0000000000000000 cur 731 last 0 00000020:00000080:0.0:1787384836.914103:0:24220:0:(genops.c:1406:class_connect()) connect: client 84891948-9b25-4376-8d8c-2664f1d91fdc, cookie 0x7ef423838fba479d 00002000:00100000:0.0:1787384836.914109:0:24220:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 84891948-9b25-4376-8d8c-2664f1d91fdc/ffff98f8d8505000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787384836.914115:0:24220:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1787384836.914158:0:24220:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787384836.914176:0:24220:0:(import.c:65:import_set_state_nolock()) ffff98f8efb5d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384836.914200:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+6:2412:x1874208182398336:12345-192.168.203.45@tcp:8:mount.lustre.0 Request processed in 147us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384836.914207:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:2.0:1787384836.918671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384836.918862:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182398592 00000100:00100000:1.0:1787384836.918883:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182398592 00000100:00100000:1.0:1787384836.918942:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 1 00000100:00100000:1.0:1787384836.918951:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+6:18259:x1874208182398592:12345-192.168.203.45@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787384836.919031:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787384836.919130:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+6:18259:x1874208182398592:12345-192.168.203.45@tcp:33:mount.lustre.0 Request processed in 180us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384836.919139:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 1 00010000:00010000:1.0:1787384836.983263:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384837.093377:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384837.093467:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182398720 00000100:00100000:1.0:1787384837.093475:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182398720 00000100:00100000:1.0:1787384837.093534:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:1.0:1787384837.093544:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+6:18292:x1874208182398720:12345-192.168.203.45@tcp:101:mkdir.0 00010000:00010000:1.0:1787384837.093564:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384837.093583:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba47a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3db4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384837.093649:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba47ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384837.093965:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba47ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384837.093978:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba47ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384837.094023:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787384837.094027:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384837.094046:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba47ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384837.094091:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba47a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3db4 expref: 8 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384837.094110:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba47ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3db4 expref: 7 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384837.094119:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384837.094122:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384837.094126:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a600, rc 0) 00000100:00100000:1.0:1787384837.094183:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+7:18292:x1874208182398720:12345-192.168.203.45@tcp:101:mkdir.0 Request processed in 640us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384837.094190:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:1.0:1787384837.559030:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203480576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384837.559098:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384837.559288:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203480576 00000100:00100000:3.0:1787384837.559298:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203480576 00000100:00100000:3.0:1787384837.559365:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787384837.559377:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203480576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384837.559399:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787384837.559443:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203480576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384837.559450:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787384837.559569:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384837.559615:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203480576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384837.559874:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384837.559885:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203480704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384837.559958:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384837.559985:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203480704 00000100:00100000:3.0:1787384837.559989:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203480704 00000100:00100000:3.0:1787384837.560014:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384837.560020:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203480704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384837.560050:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787384837.560082:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203480704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384837.560088:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384837.560118:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203480704:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787384837.560296:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787384838.011497:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384838.583032:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384838.583132:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203480832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384838.583204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384838.583259:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203480832 00000100:00100000:2.0:1787384838.583266:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203480832 00000100:00100000:2.0:1787384838.583311:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787384838.583320:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203480832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384838.583354:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787384838.583398:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203480832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384838.583405:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787384838.583450:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203480832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384838.584219:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203480960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384838.584262:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384838.584457:0:25210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203480960 00000100:00100000:1.0:1787384838.584463:0:25210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203480960 00000100:00100000:1.0:1787384838.584505:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787384838.584513:0:25210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203480960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384838.584536:0:25210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787384838.591960:0:25210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203480960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7439us (7688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384838.591974:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787384838.592191:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203480960:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787384839.031181:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384840.055130:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787384840.122216:0:22692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 84891948-9b25-4376-8d8c-2664f1d91fdc 00000001:00100000:0.0:1787384840.122230:0:22692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 348c65a2-a652-4219-ac42-befa509a5d50 00000001:00100000:0.0:1787384840.122472:0:23445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 84891948-9b25-4376-8d8c-2664f1d91fdc 00000001:00100000:0.0:1787384840.122480:0:23445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 348c65a2-a652-4219-ac42-befa509a5d50 00000001:00100000:1.0:1787384840.123905:0:24215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 84891948-9b25-4376-8d8c-2664f1d91fdc 00000001:00100000:1.0:1787384840.123916:0:24215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 348c65a2-a652-4219-ac42-befa509a5d50 00000001:02000400:2.0:1787384840.281475:0:25591:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:2.0:1787384840.570046:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787384840.630996:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203481088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384840.631035:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a654d8f2-2ab4-4025-870e-e3edf79de730:3654:1874208203481216:0@lo:400:kworker.0 00000100:00100000:0.0:1787384840.631076:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384840.631089:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384840.631147:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203481088 00000100:00100000:1.0:1787384840.631155:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203481088 00000100:00100000:3.0:1787384840.631161:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203481728:0@lo:400:kworker.0 00000100:00100000:3.0:1787384840.631196:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384840.631217:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787384840.631222:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203482240:0@lo:400:kworker.0 00000100:00100000:1.0:1787384840.631230:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203481088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384840.631259:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787384840.631264:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203481216 00000100:00100000:2.0:1787384840.631270:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203481216 00000100:00100000:2.0:1787384840.631307:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787384840.631309:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203481088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384840.631318:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+24:3654:x1874208203481216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384840.631319:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384840.631348:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203481344:0@lo:400:kworker.0 00000100:00100000:3.0:1787384840.631355:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384840.631367:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+24:3654:x1874208203481216:12345-0@lo:400:kworker.0 Request processed in 51us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384840.631383:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203482752:0@lo:400:kworker.0 00000100:00100000:1.0:1787384840.631389:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384840.631395:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787384840.631405:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203481600:0@lo:400:kworker.0 00000100:00100000:3.0:1787384840.631429:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384840.631432:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203481472:0@lo:400:kworker.0 00000100:00100000:0.0:1787384840.631439:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384840.631464:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203482112:0@lo:400:kworker.0 00000100:00100000:3.0:1787384840.631472:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a654d8f2-2ab4-4025-870e-e3edf79de730:3654:1874208203481216:0@lo:400:kworker.0 00000100:00100000:3.0:1787384840.631503:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203481728 00000100:00100000:3.0:1787384840.631513:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203481728 00000100:00100000:3.0:1787384840.631540:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203482240 00000100:00100000:3.0:1787384840.631543:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203482240 00000100:00100000:3.0:1787384840.631554:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203482752 00000100:00100000:3.0:1787384840.631556:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203482752 00000100:00100000:3.0:1787384840.631585:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787384840.631592:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203481728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384840.632611:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203481856:0@lo:400:kworker.0 00000100:00100000:2.0:1787384840.633404:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384840.633445:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203481984:0@lo:400:kworker.0 00000100:00100000:2.0:1787384840.633485:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384840.633502:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203482496:0@lo:400:kworker.0 00000100:00100000:2.0:1787384840.633524:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384840.633562:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203482496 00000100:00100000:2.0:1787384840.633568:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203482496 00000100:00100000:0.0:1787384840.633587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384840.633603:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787384840.633608:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203482624:0@lo:400:kworker.0 00000100:00100000:2.0:1787384840.633611:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203482240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384840.633631:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384840.633654:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787384840.633656:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203482240:12345-0@lo:400:kworker.0 Request processed in 46us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384840.633663:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787384840.633677:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203482624 00000100:00100000:2.0:1787384840.633680:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203482624 00000100:00100000:0.0:1787384840.633689:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203481088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384840.633694:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787384840.633699:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203482752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384840.633713:0:22712:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787384840.633721:0:22712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787384840.633728:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203482752:12345-0@lo:400:kworker.0 Request processed in 28us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384840.633734:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787384840.633736:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203481600 00000100:00100000:0.0:1787384840.633740:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203481600 00000100:00100000:2.0:1787384840.633744:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787384840.633748:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203482496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384840.633758:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203481472 00000100:00100000:0.0:1787384840.633760:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203481472 00000100:00100000:0.0:1787384840.633773:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203481984 00000100:00100000:0.0:1787384840.633791:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203481984 00000100:00100000:0.0:1787384840.635675:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203482112 00000100:00100000:0.0:1787384840.635686:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203482112 00000100:00100000:2.0:1787384840.635706:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203482496:12345-0@lo:400:kworker.0 Request processed in 1954us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384840.635707:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384840.635715:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203481600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384840.635729:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787384840.635749:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787384840.635755:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203482624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384840.635790:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203481600:12345-0@lo:400:kworker.0 Request processed in 62us (4336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384840.635796:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384840.635809:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787384840.635815:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203481472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384840.635844:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203481472:12345-0@lo:400:kworker.0 Request processed in 29us (2441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384840.635850:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787384840.635861:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787384840.635867:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203481984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384840.635903:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203481984:12345-0@lo:400:kworker.0 Request processed in 36us (2417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384840.635910:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787384840.635920:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787384840.635926:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203482112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384840.635960:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203482112:12345-0@lo:400:kworker.0 Request processed in 34us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384840.635965:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787384840.636107:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203482624:12345-0@lo:400:kworker.0 Request processed in 351us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384840.636113:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787384840.636240:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384840.636247:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384840.636250:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384840.636252:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384840.636275:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203481344 00000100:00100000:1.0:1787384840.636280:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203481344 00000100:00100000:2.0:1787384840.636294:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203481472:0@lo:400:kworker.0 00000100:00100000:2.0:1787384840.636312:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203481984:0@lo:400:kworker.0 00000100:00100000:1.0:1787384840.636318:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787384840.636329:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203481344:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787384840.636337:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35da680 x1874208203482496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384840.636350:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203482496:0@lo:400:kworker.0 00000100:00100000:1.0:1787384840.636374:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203481344:12345-0@lo:400:kworker.0 Request processed in 47us (4988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384840.636382:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787384840.636397:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203482240:0@lo:400:kworker.0 00000100:00100000:3.0:1787384840.636701:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203481728:12345-0@lo:400:kworker.0 Request processed in 5106us (5503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384840.636721:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787384840.639078:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35daa00 x1874208203482752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384840.639103:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203482752:0@lo:400:kworker.0 00000100:00100000:2.0:1787384840.639138:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203481728:0@lo:400:kworker.0 00000100:00100000:0.0:1787384840.640727:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203481600:0@lo:400:kworker.0 00000100:00100000:0.0:1787384840.640756:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203482112:0@lo:400:kworker.0 00000100:00100000:0.0:1787384840.640769:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203482624:0@lo:400:kworker.0 00000100:00100000:1.0:1787384840.642023:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384840.642073:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203482368:0@lo:400:kworker.0 00000100:00100000:1.0:1787384840.642118:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384840.642139:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203482880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384840.642163:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384840.642208:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203481344:0@lo:400:kworker.0 00000100:00100000:3.0:1787384840.642254:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203482880 00000100:00100000:3.0:1787384840.642261:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203482880 00000100:00100000:0.0:1787384840.642386:0:25210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203481856 00000100:00100000:0.0:1787384840.642391:0:25210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203481856 00000100:00100000:0.0:1787384840.642532:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384840.642551:0:25210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203481856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384840.642562:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203482368 00000100:00100000:2.0:1787384840.642568:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203482368 00000100:00100000:2.0:1787384840.642616:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787384840.642623:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203482368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384840.642693:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787384840.642704:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203482880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787384840.642733:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787384840.642824:0:25210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203481856:12345-0@lo:400:kworker.0 Request processed in 274us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384840.642826:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203482368:12345-0@lo:400:kworker.0 Request processed in 202us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384840.642839:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787384840.642855:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787384840.642880:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384840.643030:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203481856:0@lo:400:kworker.0 00000100:00100000:2.0:1787384840.643053:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203482368:0@lo:400:kworker.0 00000100:00100000:3.0:1787384840.650202:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203482880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7490us (8027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384840.650303:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203482880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384840.650382:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1787384841.085399:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384842.088227:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384842.088282:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384842.088285:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182398976 00000100:00100000:3.0:1787384842.088300:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182398976 00000100:00100000:2.0:1787384842.088314:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384842.088357:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384842.088382:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182399488 00000100:00100000:3.0:1787384842.088387:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182399488 00000100:00100000:2.0:1787384842.088392:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384842.088424:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 51 00000100:00100000:2.0:1787384842.088435:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384842.088441:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+6:2415:x1874208182398976:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384842.088541:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+6:2415:x1874208182398976:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 107us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384842.088550:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 51 00000100:00100000:2.0:1787384842.088960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384842.088984:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384842.089329:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182399232 00000100:00100000:0.0:1787384842.089337:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182399232 00000100:00100000:0.0:1787384842.089389:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182399744 00000100:00100000:0.0:1787384842.089392:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182399744 00000100:00100000:0.0:1787384842.089406:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182399360 00000100:00100000:0.0:1787384842.089408:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182399360 00000100:00100000:0.0:1787384842.089427:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:0.0:1787384842.089435:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:2415:x1874208182399232:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384842.089493:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:2415:x1874208182399232:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 58us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384842.089500:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:0.0:1787384842.089518:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:0.0:1787384842.089543:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c869f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2415:x1874208182399744:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384842.089570:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c869f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2415:x1874208182399744:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 28us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384842.089576:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:0.0:1787384842.089737:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:0.0:1787384842.089745:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:2415:x1874208182399360:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384842.089772:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:2415:x1874208182399360:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 28us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384842.089811:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:0.0:1787384842.089836:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182398848 00000100:00100000:0.0:1787384842.089840:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182398848 00000100:00100000:0.0:1787384842.089883:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 147 00000100:00100000:0.0:1787384842.089890:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+13:2415:x1874208182398848:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384842.089917:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+13:2415:x1874208182398848:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 28us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384842.089924:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 147 00000100:00100000:0.0:1787384842.096407:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182399104 00000100:00100000:0.0:1787384842.096427:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182399104 00000100:00100000:0.0:1787384842.096494:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:0.0:1787384842.096508:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+6:2415:x1874208182399488:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384842.096622:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+6:2415:x1874208182399488:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 117us (8306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384842.096632:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:0.0:1787384842.096658:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182399616 00000100:00100000:0.0:1787384842.096681:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182399616 00000100:00100000:0.0:1787384842.096708:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:0.0:1787384842.096714:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:2415:x1874208182399104:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384842.096747:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:2415:x1874208182399104:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 33us (8313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384842.096754:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:2.0:1787384842.096966:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384842.097266:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:3.0:1787384842.097288:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2415:x1874208182399616:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384842.097326:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2415:x1874208182399616:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 41us (8341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384842.097332:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:1.0:1787384842.097606:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182399872 00000100:00100000:1.0:1787384842.097613:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182399872 00000100:00080000:0.0:1787384842.097757:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384842.097913:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:1.0:1787384842.097924:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84891948-9b25-4376-8d8c-2664f1d91fdc+6:2415:x1874208182399872:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384842.097976:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84891948-9b25-4376-8d8c-2664f1d91fdc+6:2415:x1874208182399872:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 56us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384842.097983:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00080000:0.0:1787384842.098023:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384842.098027:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787384842.098031:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787384842.104132:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384842.679550:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203483008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384842.679644:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384842.679746:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203483008 00000100:00100000:0.0:1787384842.679757:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203483008 00000100:00100000:0.0:1787384842.679940:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787384842.679950:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203483008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787384842.679990:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1787384842.685162:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384842.686281:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384842.686305:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203483136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384842.690542:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384842.690703:0:24222:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787384842.690718:0:24222:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1787384842.691070:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203483136 00000100:00100000:1.0:1787384842.691635:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203483136 00000100:00100000:1.0:1787384842.692187:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384842.692200:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203483136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384842.692233:0:25681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787384842.692380:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203483136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384842.692389:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787384842.692679:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203483008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 12730us (13034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384842.692688:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1787384842.693002:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384842.693241:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203483008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384842.693296:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203483136:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787384842.694259:0:25033:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 84891948-9b25-4376-8d8c-2664f1d91fdc 00010000:00010000:1.0:1787384843.131189:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384843.703018:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203483264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384843.703089:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384843.703380:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384843.703390:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203483392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384843.703420:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384843.703490:0:25210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203483264 00000100:00100000:2.0:1787384843.703498:0:25210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203483264 00000100:00100000:2.0:1787384843.703561:0:25210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203483392 00000100:00100000:2.0:1787384843.703565:0:25210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203483392 00000100:00100000:2.0:1787384843.703582:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787384843.703590:0:25210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203483264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384843.703622:0:25210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787384843.703670:0:25210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203483264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384843.703678:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787384843.703695:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787384843.703701:0:25210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203483392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384843.703715:0:25210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787384843.703745:0:25210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203483392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384843.703750:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787384843.703810:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203483392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384843.703844:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203483264:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1787384843.990331:0:25741:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffcc76f4600 00000020:00000080:0.0:1787384843.990348:0:25741:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787384843.990353:0:25741:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787384843.990365:0:25741:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc76f6890 20000000:00000080:0.0:1787384843.990380:0:25741:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f8ef613400 uarg=0000000000000000 20000000:01000000:0.0:1787384843.990422:0:25741:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787384843.990428:0:25741:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787384843.990433:0:25741:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787384843.992768:0:25742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787384843.993193:0:25741:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787384844.000377:0:25741:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787384844.000635:0:25741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.000656:0:25741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2090000/0x7ef423838fba440f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4408 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.000664:0:25741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba441d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4416 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.000671:0:25741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2091200/0x7ef423838fba445c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba4455 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.000692:0:25741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c3b04800/0x7ef423838fba45dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba45d6 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.000703:0:25741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba4742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d13 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.000711:0:25741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8d965a200/0x7ef423838fba4781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d83 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.000719:0:25741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.000763:0:25741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8d965a200/0x7ef423838fba4781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d83 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.000815:0:25741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8d965a200/0x7ef423838fba4781 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d83 expref: 12 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384844.000831:0:25741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25741:1874208203483520:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384844.000947:0:25741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba4742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d13 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.000966:0:25741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba4742 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d13 expref: 12 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384844.000976:0:25741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25741:1874208203483648:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384844.001018:0:25741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c3b04800/0x7ef423838fba45dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba45d6 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.001039:0:25741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c3b04800/0x7ef423838fba45dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba45d6 expref: 23 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384844.001048:0:25741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25741:1874208203483776:0@lo:104: 00000100:00100000:2.0:1787384844.001091:0:25741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384844.001131:0:25741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2091200/0x7ef423838fba445c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba4455 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.001140:0:25741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c2091200/0x7ef423838fba445c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba4455 expref: 23 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384844.001148:0:25741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25741:1874208203483904:0@lo:104: 00000100:00100000:2.0:1787384844.001171:0:25741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384844.001200:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203483776 00000100:00100000:2.0:1787384844.001207:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203483776 00000100:00100000:2.0:1787384844.001245:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203483904 00000100:00100000:2.0:1787384844.001248:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203483904 00000100:00100000:2.0:1787384844.001265:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384844.001273:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+4:25741:x1874208203483776:12345-0@lo:104: 00010000:00010000:2.0:1787384844.001284:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba45dd expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.001331:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384844.001337:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+4:25741:x1874208203483776:12345-0@lo:104: Request processed in 65us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384844.001345:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384844.001364:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384844.001370:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+3:25741:x1874208203483904:12345-0@lo:104: 00010000:00010000:2.0:1787384844.001386:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba445c expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.001424:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787384844.001430:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+3:25741:x1874208203483904:12345-0@lo:104: Request processed in 60us (259us total) trans 0 rc 0/0 00010000:00010000:0.0:1787384844.001975:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384844.001983:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba45dd expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.001992:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031400 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384844.001996:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba45dd expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002003:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba45dd expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384844.002010:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba45dd expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384844.002015:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384844.002053:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba45dd expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002061:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384844.002081:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba45dd expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002088:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8c0031400/0x7ef423838fba45d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba45dd expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002131:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384844.002134:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba445c expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002139:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384844.002142:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba445c expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002148:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba445c expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384844.002154:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba445c expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384844.002159:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384844.002174:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba445c expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002180:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384844.002194:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba445c expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002201:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba4455 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba445c expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002211:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384844.002213:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384844.002215:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384844.002228:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203484032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384844.002270:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384844.002369:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203484160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384844.002395:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384844.002432:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203484032 00000100:00100000:0.0:1787384844.002449:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203484032 00010000:00010000:0.0:1787384844.002469:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c3b04800/0x7ef423838fba45dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba45d6 expref: 24 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384844.002489:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203484160 00000100:00100000:0.0:1787384844.002492:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203484160 00010000:00010000:0.0:1787384844.002502:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2091200/0x7ef423838fba445c lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba4455 expref: 25 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384844.002517:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384844.002523:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+25:3652:x1874208203484032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384844.002533:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384844.002538:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c3b04800/0x7ef423838fba45dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba45d6 expref: 25 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002546:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c3b04800/0x7ef423838fba45dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba45d6 expref: 25 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002563:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384844.002592:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+25:3652:x1874208203484032:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384844.002599:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384844.002616:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384844.002622:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+24:3653:x1874208203484160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384844.002628:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384844.002639:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2091200/0x7ef423838fba445c lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba4455 expref: 24 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002646:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2091200/0x7ef423838fba445c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba4455 expref: 24 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384844.002655:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384844.002683:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+24:3653:x1874208203484160:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384844.002688:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384844.002729:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a654d8f2-2ab4-4025-870e-e3edf79de730:3653:1874208203484160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384844.002752:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203484032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384844.004285:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787384844.004325:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384844.004378:0:25741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba441d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba4416 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.004393:0:25741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba441d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba4416 expref: 23 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384844.004405:0:25741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25741:1874208203484288:0@lo:104: 00000100:00100000:2.0:1787384844.004572:0:25741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384844.004658:0:25741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2090000/0x7ef423838fba440f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba4408 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.004667:0:25741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c2090000/0x7ef423838fba440f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba4408 expref: 23 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384844.004676:0:25741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25741:1874208203484416:0@lo:104: 00000100:00100000:2.0:1787384844.004698:0:25741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384844.007694:0:25741:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ce4780 going to sleep for 11 seconds 00010000:00010000:2.0:1787384844.007736:0:25741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3b04800/0x7ef423838fba45dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba45d6 expref: 23 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384844.007751:0:25741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25741:1874208203483776:0@lo:104: 00010000:00010000:2.0:1787384844.007812:0:25741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2091200/0x7ef423838fba445c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba4455 expref: 22 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384844.007823:0:25741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25741:1874208203483904:0@lo:104: 00000100:00100000:3.0:1787384844.010406:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203484288 00000100:00100000:0.0:1787384844.010406:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203484416 00000100:00100000:0.0:1787384844.010420:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203484416 00000100:00100000:2.0:1787384844.010561:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384844.010653:0:25741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25741:1874208203483520:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384844.010677:0:25741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25741:1874208203483648:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384844.010840:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203484288 00000100:00100000:3.0:1787384844.010902:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787384844.010912:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+4:25741:x1874208203484288:12345-0@lo:104: 00010000:00010000:3.0:1787384844.010928:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba441d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384844.011004:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787384844.011010:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a654d8f2-2ab4-4025-870e-e3edf79de730+4:25741:x1874208203484288:12345-0@lo:104: Request processed in 100us (6438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384844.011017:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787384844.011044:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384844.011050:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba441d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384844.011058:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cdc00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:3.0:1787384844.011062:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba441d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384844.011067:0:25741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25741:1874208203484288:0@lo:104: 00010000:00010000:3.0:1787384844.011072:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba441d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384844.011092:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba441d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384844.011098:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787384844.011143:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba441d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384844.011150:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384844.011171:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba441d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384844.011177:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba4416 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba441d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384844.011190:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384844.011191:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384844.011193:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384844.011207:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a654d8f2-2ab4-4025-870e-e3edf79de730:3654:1874208203484544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384844.012976:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787384844.012996:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+3:25741:x1874208203484416:12345-0@lo:104: 00010000:00010000:1.0:1787384844.013012:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba440f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.013080:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384844.013087:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a654d8f2-2ab4-4025-870e-e3edf79de730+3:25741:x1874208203484416:12345-0@lo:104: Request processed in 102us (8387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384844.013094:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787384844.013138:0:25741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25741:1874208203484416:0@lo:104: 00010000:00010000:1.0:1787384844.013175:0:25741:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384844.013411:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00010000:00010000:2.0:1787384844.013486:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384844.013492:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba440f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.013500:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc000 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384844.013503:0:22701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba440f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.013512:0:22701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba440f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384844.013519:0:22701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba440f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384844.013525:0:22701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787384844.013556:0:22701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba440f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.013563:0:22701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384844.013583:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba440f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.013590:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba4408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba440f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384844.013624:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384844.013625:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384844.013627:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384844.013802:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203484672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384844.013846:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384844.014039:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384844.014326:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182400128 00000100:00100000:1.0:1787384844.014334:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182400128 00010000:00010000:1.0:1787384844.014360:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba4742 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d13 expref: 13 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384844.014378:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182400000 00000100:00100000:1.0:1787384844.014381:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182400000 00010000:00010000:1.0:1787384844.014393:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8d965a200/0x7ef423838fba4781 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d83 expref: 14 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384844.014404:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203484672 00000100:00100000:1.0:1787384844.014407:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203484672 00010000:00010000:1.0:1787384844.014417:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2090000/0x7ef423838fba440f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba4408 expref: 22 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384844.014427:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203484544 00000100:00100000:1.0:1787384844.014429:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203484544 00010000:00010000:1.0:1787384844.014511:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba441d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba4416 expref: 23 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384844.014527:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:1.0:1787384844.014535:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d482831-3a49-488a-9a1d-d55fc29705fa+14:2416:x1874208182400128:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384844.014547:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384844.014552:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba4742 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d13 expref: 14 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.014562:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba4742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d13 expref: 14 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.014576:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba4742 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d13 expref: 14 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.014590:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384844.014674:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d482831-3a49-488a-9a1d-d55fc29705fa+13:2416:x1874208182400128:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 139us (4117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384844.014682:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:1.0:1787384844.014699:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:1.0:1787384844.014705:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d482831-3a49-488a-9a1d-d55fc29705fa+12:2416:x1874208182400000:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384844.014712:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384844.014717:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8d965a200/0x7ef423838fba4781 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d83 expref: 12 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.014727:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8d965a200/0x7ef423838fba4781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d83 expref: 12 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.014738:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8d965a200/0x7ef423838fba4781 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d83 expref: 12 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.014755:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384844.014803:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d482831-3a49-488a-9a1d-d55fc29705fa+11:2416:x1874208182400000:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 98us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384844.014810:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:1.0:1787384844.014821:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384844.014827:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a654d8f2-2ab4-4025-870e-e3edf79de730+23:3651:x1874208203484672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384844.014834:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384844.014838:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2090000/0x7ef423838fba440f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba4408 expref: 23 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.014846:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2090000/0x7ef423838fba440f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba4408 expref: 23 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.014855:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090000/0x7ef423838fba440f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba4408 expref: 23 pid: 22706 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.014874:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384844.014909:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a654d8f2-2ab4-4025-870e-e3edf79de730+22:3651:x1874208203484672:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384844.014915:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384844.014937:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787384844.014944:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c405c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a654d8f2-2ab4-4025-870e-e3edf79de730+21:3654:x1874208203484544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384844.015164:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384844.015170:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba441d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba4416 expref: 21 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015181:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba441d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba4416 expref: 21 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015201:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba441d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba4416 expref: 21 pid: 22705 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015212:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015219:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015235:0:22699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015243:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015250:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015257:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015263:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384844.015268:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015275:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015292:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015313:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384844.015346:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c405c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a654d8f2-2ab4-4025-870e-e3edf79de730+20:3654:x1874208203484544:12345-0@lo:103:ldlm_bl.0 Request processed in 403us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384844.015353:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787384844.015415:0:25741:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015423:0:25741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384844.015429:0:25741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384844.017569:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a654d8f2-2ab4-4025-870e-e3edf79de730:3651:1874208203484672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384844.017919:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a654d8f2-2ab4-4025-870e-e3edf79de730:3654:1874208203484544:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384844.151342:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384844.663353:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787384845.175456:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384845.290764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384845.291039:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182400256 00000100:00100000:1.0:1787384845.291050:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182400256 00000100:00100000:1.0:1787384845.291108:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 148 00000100:00100000:1.0:1787384845.291119:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+11:18143:x1874208182400256:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384845.291137:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384845.291158:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965a200/0x7ef423838fba47b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3dbb expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384845.291188:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965a200/0x7ef423838fba47b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dbb expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384845.291200:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965a200/0x7ef423838fba47b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dbb expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384845.291229:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a200, rc 0) 00000100:00100000:1.0:1787384845.291287:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+12:18143:x1874208182400256:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 Request processed in 169us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384845.291294:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 148 00000100:00100000:2.0:1787384845.299679:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384845.300191:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182400384 00000100:00100000:0.0:1787384845.300201:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182400384 00000100:00100000:0.0:1787384845.300318:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 149 00000100:00100000:0.0:1787384845.300328:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+12:18143:x1874208182400384:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384845.300493:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+12:18143:x1874208182400384:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 Request processed in 166us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.300502:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 149 00000100:00100000:2.0:1787384845.318676:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384845.320337:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182400512 00000100:00100000:0.0:1787384845.320352:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182400512 00000100:00100000:0.0:1787384845.320415:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 150 00000100:00100000:0.0:1787384845.320425:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+12:18143:x1874208182400512:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384845.320566:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+12:18143:x1874208182400512:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 Request processed in 141us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.320575:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 150 00000100:00100000:2.0:1787384845.341534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384845.342046:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182400640 00000100:00100000:0.0:1787384845.342056:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182400640 00000100:00100000:0.0:1787384845.342120:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 151 00000100:00100000:0.0:1787384845.342131:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+12:18143:x1874208182400640:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384845.342148:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384845.342167:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b04e00/0x7ef423838fba47c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3dc2 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.342195:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b04e00/0x7ef423838fba47c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dc2 expref: 13 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.342206:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b04e00/0x7ef423838fba47c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dc2 expref: 13 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.342216:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04e00, rc 0) 00000100:00100000:0.0:1787384845.342288:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18143:x1874208182400640:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 Request processed in 158us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.342294:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 151 00000100:00100000:2.0:1787384845.353915:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384845.355387:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182400768 00000100:00100000:0.0:1787384845.355401:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182400768 00000100:00100000:0.0:1787384845.355532:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 152 00000100:00100000:0.0:1787384845.355552:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18143:x1874208182400768:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384845.355722:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18143:x1874208182400768:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 Request processed in 181us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.355730:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 152 00000100:00100000:2.0:1787384845.366941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384845.367091:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182400896 00000100:00100000:1.0:1787384845.367101:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182400896 00000100:00100000:1.0:1787384845.367162:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 153 00000100:00100000:1.0:1787384845.367172:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18143:x1874208182400896:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384845.367333:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482831-3a49-488a-9a1d-d55fc29705fa+13:18143:x1874208182400896:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 Request processed in 162us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384845.367341:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 153 10000000:01000000:1.0:1787384845.687946:0:22709:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787384845.687955:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f5698000 from 13 10000000:01000000:1.0:1787384845.687960:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787384845.688011:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a400/0x7ef423838fba47c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384845.688024:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8d965a400/0x7ef423838fba47c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384845.688034:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8d965a400/0x7ef423838fba47c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384845.688060:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203484800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787384845.688128:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384845.688177:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e8a053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384845.690500:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203484800 00000100:00100000:0.0:1787384845.690515:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203484800 00000100:00100000:0.0:1787384845.690591:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787384845.690600:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+20:22709:x1874208203484800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384845.690614:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384845.690632:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b04400/0x7ef423838fba47ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba47c7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.690656:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b04400/0x7ef423838fba47ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba47c7 expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.690668:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b04400/0x7ef423838fba47ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba47c7 expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.690677:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04400, rc 0) 00000100:00100000:0.0:1787384845.690754:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+21:22709:x1874208203484800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.690760:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787384845.690916:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203484800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384845.690934:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8d965a400/0x7ef423838fba47c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba47ce expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384845.690943:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8d965a400/0x7ef423838fba47c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba47ce expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384845.691016:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203484928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384845.691059:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384845.691092:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ce4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787384845.692915:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203484928 00000100:00100000:0.0:1787384845.692928:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203484928 00000100:00100000:0.0:1787384845.693000:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787384845.693009:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:22709:x1874208203484928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384845.693177:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:22709:x1874208203484928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (2128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.693185:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787384845.693446:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203484928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384845.693492:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384845.693536:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384845.693573:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ce4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384845.693636:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203485056 00000100:00100000:1.0:1787384845.693642:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203485056 00000100:00100000:1.0:1787384845.693672:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787384845.693679:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+21:22709:x1874208203485056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384845.693764:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+21:22709:x1874208203485056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384845.693771:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787384845.693902:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787384845.695205:0:25754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787384845.695437:0:22709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787384845.695462:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384845.695473:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a400/0x7ef423838fba47c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba47ce expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384845.695484:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8d965a400/0x7ef423838fba47c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba47ce expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384845.695509:0:22709:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384845.695511:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8d9149000 from 13 10000000:01000000:3.0:1787384845.695514:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384845.695559:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825800/0x7ef423838fba47d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384845.695567:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5825800/0x7ef423838fba47d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384845.695576:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5825800/0x7ef423838fba47d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384845.695596:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384845.695649:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.695686:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384845.695972:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203485184 00000100:00100000:0.0:1787384845.695979:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203485184 00000100:00100000:0.0:1787384845.696030:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787384845.696038:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+21:22709:x1874208203485184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384845.696051:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384845.696065:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba47dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba47d5 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.696087:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba47dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba47d5 expref: 22 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.696099:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba47dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba47d5 expref: 22 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.696108:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04600, rc 0) 00000100:00100000:0.0:1787384845.696154:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+22:22709:x1874208203485184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.696161:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787384845.696245:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384845.696258:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5825800/0x7ef423838fba47d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba47dc expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384845.696267:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5825800/0x7ef423838fba47d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba47dc expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384845.696320:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384845.696344:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.696373:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384845.696416:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203485312 00000100:00100000:0.0:1787384845.696420:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203485312 00000100:00100000:0.0:1787384845.696452:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787384845.696458:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+22:22709:x1874208203485312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384845.696566:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+22:22709:x1874208203485312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.696581:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787384845.696698:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384845.696726:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384845.696803:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.696818:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384845.696944:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203485440 00000100:00100000:1.0:1787384845.696949:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203485440 00000100:00100000:1.0:1787384845.696982:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787384845.696989:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+22:22709:x1874208203485440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384845.697063:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+22:22709:x1874208203485440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384845.697070:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787384845.697241:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787384845.699446:0:25755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787384845.705666:0:22709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787384845.705710:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384845.705724:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825800/0x7ef423838fba47d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba47dc expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384845.705736:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5825800/0x7ef423838fba47d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba47dc expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384845.705747:0:22709:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384845.705750:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8efb5a800 from 13 10000000:01000000:3.0:1787384845.705752:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384845.705821:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba47e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384845.705829:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba47e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384845.705840:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba47e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384845.705876:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384845.705941:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.705977:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384845.706170:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203485568 00000100:00100000:1.0:1787384845.706178:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203485568 00000100:00100000:1.0:1787384845.706239:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787384845.706249:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+22:22709:x1874208203485568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384845.706262:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384845.706274:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965b600/0x7ef423838fba47ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba47e3 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384845.706298:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965b600/0x7ef423838fba47ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba47e3 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384845.706308:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965b600/0x7ef423838fba47ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba47e3 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384845.706334:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b600, rc 0) 00000100:00100000:1.0:1787384845.706380:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+23:22709:x1874208203485568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384845.706388:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787384845.706553:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384845.706567:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba47e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba47ea expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384845.706583:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba47e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba47ea expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384845.706643:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384845.706670:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.706699:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384845.706744:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203485696 00000100:00100000:0.0:1787384845.706749:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203485696 00000100:00100000:0.0:1787384845.706866:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787384845.706874:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+23:22709:x1874208203485696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384845.706973:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+23:22709:x1874208203485696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.706979:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787384845.707172:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384845.707199:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384845.707252:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.707310:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384845.707497:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203485824 00000100:00100000:2.0:1787384845.707503:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203485824 00000100:00100000:2.0:1787384845.707547:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787384845.707554:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+23:22709:x1874208203485824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384845.707635:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+23:22709:x1874208203485824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384845.707642:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787384845.709867:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787384845.711982:0:25756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787384845.712181:0:22709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787384845.712218:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384845.712231:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba47e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba47ea expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384845.712243:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba47e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba47ea expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384845.712254:0:22709:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384845.712257:0:22709:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f0fb9000 from 13 10000000:01000000:3.0:1787384845.712259:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384845.712298:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba47f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384845.712306:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba47f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384845.712331:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba47f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384845.712358:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384845.712422:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.712463:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384845.713320:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203485952 00000100:00100000:2.0:1787384845.713330:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203485952 00000100:00100000:2.0:1787384845.713380:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787384845.713389:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+23:22709:x1874208203485952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384845.713403:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384845.713419:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba47f1 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384845.713444:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba47f1 expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384845.713454:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c0030e00/0x7ef423838fba47f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba47f1 expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384845.713463:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c0030e00, rc 0) 00000100:00100000:2.0:1787384845.714097:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a654d8f2-2ab4-4025-870e-e3edf79de730+24:22709:x1874208203485952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 707us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384845.714106:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787384845.718559:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203485952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384845.718589:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba47f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba47f8 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.718603:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba47f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba47f8 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384845.718695:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203486080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384845.718753:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384845.718832:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d94623c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384845.719175:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203486080 00000100:00100000:3.0:1787384845.719182:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203486080 00000100:00100000:3.0:1787384845.719232:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787384845.719243:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+24:22709:x1874208203486080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384845.719382:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+24:22709:x1874208203486080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384845.719389:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787384845.721712:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203486080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384845.722151:0:22709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203486208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384845.722228:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384845.722258:0:22709:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d94623c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384845.722393:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203486208 00000100:00100000:1.0:1787384845.722401:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203486208 00000100:00100000:1.0:1787384845.722451:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787384845.722460:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+24:22709:x1874208203486208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384845.722583:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a654d8f2-2ab4-4025-870e-e3edf79de730+24:22709:x1874208203486208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384845.722590:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787384845.722762:0:22709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a654d8f2-2ab4-4025-870e-e3edf79de730:22709:1874208203486208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787384845.725582:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787384845.725844:0:22709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787384845.725876:0:22709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384845.725887:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba47f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba47f8 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384845.725898:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba47f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba47f8 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384845.751068:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384845.751091:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203486336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384845.751158:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384845.751421:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203486336 00000100:00100000:1.0:1787384845.751429:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203486336 00000100:00100000:1.0:1787384845.751484:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384845.751495:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203486336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384845.751529:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787384845.751577:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203486336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384845.751584:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384845.751629:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203486336:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787384845.751697:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384845.751895:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f4a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203486848:0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.751926:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384845.751948:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203487360:0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.751972:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384845.751992:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787384845.751998:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203486720:0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.752019:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384845.752037:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203487232:0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.752057:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384845.752071:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203487744:0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.752094:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384845.752121:0:25210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203486848 00000100:00100000:0.0:1787384845.752126:0:25210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203486848 00000100:00100000:0.0:1787384845.752156:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787384845.752163:0:25210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203486848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.752201:0:25210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203486848:12345-0@lo:400:kworker.0 Request processed in 39us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.752226:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787384845.752247:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203487360 00000100:00100000:0.0:1787384845.752250:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203487360 00000100:00100000:0.0:1787384845.752279:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203486720 00000100:00100000:0.0:1787384845.752281:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203486720 00000100:00100000:0.0:1787384845.752292:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203487232 00000100:00100000:0.0:1787384845.752294:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203487232 00000100:00100000:0.0:1787384845.752321:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203487744 00000100:00100000:0.0:1787384845.752324:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203487744 00000100:00100000:0.0:1787384845.752339:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787384845.752345:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203487360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.752376:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203487360:12345-0@lo:400:kworker.0 Request processed in 31us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.752382:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787384845.752394:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787384845.752400:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203486720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.752424:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203486720:12345-0@lo:400:kworker.0 Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.752430:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787384845.752440:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787384845.752445:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203487232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.752471:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203487232:12345-0@lo:400:kworker.0 Request processed in 25us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.752476:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787384845.752486:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787384845.752491:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203487744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.752512:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203487744:12345-0@lo:400:kworker.0 Request processed in 22us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.752517:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1787384845.752538:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384845.752541:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384845.752558:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203486720:0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.752567:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203487232:0@lo:400:kworker.0 00010000:00080000:0.0:1787384845.752584:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a01f80 x1874208203487744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384845.752594:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203487744:0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.752602:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f4a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203486848:0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.752610:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203487360:0@lo:400:kworker.0 00000100:00100000:3.0:1787384845.752766:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203486464:0@lo:400:kworker.0 00000100:00100000:3.0:1787384845.752822:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.752855:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203486976:0@lo:400:kworker.0 00000100:00100000:3.0:1787384845.752877:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.752902:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203487488:0@lo:400:kworker.0 00000100:00100000:3.0:1787384845.752928:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.752943:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787384845.752948:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203486592:0@lo:400:kworker.0 00000100:00100000:3.0:1787384845.752969:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.752984:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203487104:0@lo:400:kworker.0 00000100:00100000:3.0:1787384845.753003:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.753015:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203487616:0@lo:400:kworker.0 00000100:00100000:3.0:1787384845.753034:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384845.753060:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203486976 00000100:00100000:3.0:1787384845.753064:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203486976 00000100:00100000:3.0:1787384845.753093:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203486592 00000100:00100000:3.0:1787384845.753096:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203486592 00000100:00100000:3.0:1787384845.753109:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203487104 00000100:00100000:3.0:1787384845.753112:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203487104 00000100:00100000:3.0:1787384845.753126:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787384845.753132:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203486976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384845.753167:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203486976:12345-0@lo:400:kworker.0 Request processed in 36us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384845.753173:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787384845.753184:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787384845.753190:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203486592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384845.753229:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203486592:12345-0@lo:400:kworker.0 Request processed in 39us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384845.753235:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787384845.753246:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787384845.753252:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203487104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384845.753288:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203487104:12345-0@lo:400:kworker.0 Request processed in 36us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384845.753294:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787384845.753325:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203486592:0@lo:400:kworker.0 00000100:00100000:3.0:1787384845.753334:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203487104:0@lo:400:kworker.0 00000100:00100000:3.0:1787384845.753343:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203486976:0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.753501:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203486464 00000100:00100000:0.0:1787384845.753506:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203486464 00000100:00100000:0.0:1787384845.753531:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787384845.753538:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203486464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.753577:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203486464:12345-0@lo:400:kworker.0 Request processed in 39us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.753583:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787384845.753604:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203487488 00000100:00100000:0.0:1787384845.753607:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203487488 00000100:00100000:0.0:1787384845.753630:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203487616 00000100:00100000:0.0:1787384845.753633:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203487616 00000100:00100000:0.0:1787384845.753647:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787384845.753652:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203487488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.753680:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203487488:12345-0@lo:400:kworker.0 Request processed in 28us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.753686:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787384845.753696:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787384845.753702:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203487616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.753727:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203487616:12345-0@lo:400:kworker.0 Request processed in 26us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.753743:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787384845.753760:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384845.753763:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384845.753765:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384845.753767:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384845.753803:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203487616:0@lo:400:kworker.0 00000100:00100000:0.0:1787384845.753813:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203486464:0@lo:400:kworker.0 00010000:00080000:0.0:1787384845.753823:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a03100 x1874208203487488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384845.753833:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203487488:0@lo:400:kworker.0 00000100:00100000:1.0:1787384845.754197:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384845.762259:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203487872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384845.762337:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384845.762475:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203487872 00000100:00100000:1.0:1787384845.762484:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203487872 00000100:00100000:1.0:1787384845.762540:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787384845.762550:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203487872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787384845.762587:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787384845.762641:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203487872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384845.762647:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787384845.762737:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203487872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384845.911308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384845.911409:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182401024 00000100:00100000:0.0:1787384845.911418:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182401024 00000100:00100000:0.0:1787384845.911501:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:0.0:1787384845.911510:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+6:18761:x1874208182401024:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384845.911532:0:25603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384845.911554:0:25603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba47ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3dc9 expref: -99 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911616:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4806 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911628:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4806 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911651:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4806 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911677:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba480d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911684:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba480d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911691:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba480d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911769:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05800/0x7ef423838fba4814 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911815:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05800/0x7ef423838fba4814 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911823:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05800/0x7ef423838fba4814 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384845.911864:0:25603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787384845.911867:0:25603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384845.911899:0:25603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05800/0x7ef423838fba4814 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911909:0:25603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4806 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911914:0:25603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4806 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911929:0:25603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4806 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911934:0:25603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384845.911949:0:25603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4806 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911957:0:25603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4806 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911974:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384845.911977:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384845.911982:0:25603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911987:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.911999:0:25603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba480d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.912005:0:25603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba480d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.912010:0:25603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba480d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.912015:0:25603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384845.912017:0:25603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba480d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.912031:0:25603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba480d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.912038:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98f7c3a9de00) 00010000:00010000:0.0:1787384845.912040:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384845.912042:0:25603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba480d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.912047:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba480d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.912076:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba47ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dc9 expref: 8 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.912088:0:25603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05800/0x7ef423838fba4814 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dc9 expref: 7 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787384845.912194:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787384845.912328:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f7c3a9df00) 00010000:00010000:0.0:1787384845.912331:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384845.912334:0:25603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05800, rc 0) 00000100:00100000:0.0:1787384845.912401:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+7:18761:x1874208182401024:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 891us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.912408:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:3.0:1787384845.918391:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384845.918485:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182401152 00000100:00100000:2.0:1787384845.918508:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182401152 00000100:00100000:2.0:1787384845.918563:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:2.0:1787384845.918571:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:348c65a2-a652-4219-ac42-befa509a5d50+7:18761:x1874208182401152:12345-192.168.203.45@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787384845.918651:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:348c65a2-a652-4219-ac42-befa509a5d50+7:18761:x1874208182401152:12345-192.168.203.45@tcp:900:lhsmtool_posix.0 Request processed in 81us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384845.918659:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:2.0:1787384845.925141:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384845.925238:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182401408 00000100:00100000:0.0:1787384845.925250:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182401408 00000100:00100000:0.0:1787384845.925315:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:0.0:1787384845.925326:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+7:18761:x1874208182401408:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384845.925363:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384845.925382:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba481b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3dd0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.925454:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4822 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.925567:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4822 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.925581:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4822 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.925598:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4829 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.925605:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4829 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.925611:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4829 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.925713:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba4830 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.925721:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba4830 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.925728:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba4830 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384845.925738:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787384845.926271:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4822 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926281:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4822 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926288:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4822 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926293:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384845.926298:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4822 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926306:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4822 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926319:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f7c3a9df00) 00010000:00010000:0.0:1787384845.926322:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384845.926327:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4822 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926333:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4822 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926348:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4829 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926354:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4829 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926360:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4829 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926376:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384845.926379:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4829 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926386:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4829 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926394:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98f7c3a9de00) 00010000:00010000:0.0:1787384845.926397:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384845.926400:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4829 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.926405:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4829 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.927657:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba481b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dd0 expref: 10 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.927681:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba4830 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dd0 expref: 9 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384845.927689:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9d600) 00010000:00010000:0.0:1787384845.927692:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384845.927694:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05a00, rc 0) 00000100:00100000:0.0:1787384845.927863:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+9:18761:x1874208182401408:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 2536us (2728us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787384845.927872:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:1.0:1787384845.942316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384845.942568:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182401536 00000100:00100000:2.0:1787384845.942577:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182401536 00000100:00100000:2.0:1787384845.942645:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:2.0:1787384845.942655:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348c65a2-a652-4219-ac42-befa509a5d50+9:18761:x1874208182401536:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787384845.942757:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348c65a2-a652-4219-ac42-befa509a5d50+9:18761:x1874208182401536:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 Request processed in 104us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384845.942764:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:3.0:1787384845.950875:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384845.951094:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182401664 00000100:00100000:1.0:1787384845.951104:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182401664 00000100:00100000:1.0:1787384845.951186:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 26 00000100:00100000:1.0:1787384845.951197:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:18761:x1874208182401664:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1787384845.951887:0:22713:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 647us 00000100:00080000:2.0:1787384845.955692:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384845.964717:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:18761:x1874208182401664:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 Request processed in 13512us (13842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384845.964738:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 26 00000100:00100000:3.0:1787384846.006250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384846.006342:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182401792 00000100:00100000:0.0:1787384846.006352:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182401792 00000100:00100000:0.0:1787384846.006454:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:0.0:1787384846.006473:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+9:18767:x1874208182401792:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384846.006495:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384846.006516:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba483e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3dd7 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006578:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4845 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006593:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4845 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006604:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4845 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006675:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba484c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006682:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba484c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006688:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba484c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006733:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4845 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006757:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4845 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006773:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4845 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006816:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384846.006821:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4845 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006829:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4845 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006843:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384846.006856:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384846.006861:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4845 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006867:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba4845 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006881:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba484c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006886:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba484c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006892:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba484c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006896:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384846.006905:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba484c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006911:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba484c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006918:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98f7c3a9de00) 00010000:00010000:0.0:1787384846.006920:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384846.006923:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba484c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.006928:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba484c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.007035:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba483e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dd7 expref: 10 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.007046:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384846.007048:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384846.007051:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba483e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dd7 expref: 10 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.007061:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04000, rc 0) 00000100:00100000:0.0:1787384846.007237:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+9:18767:x1874208182401792:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 774us (996us total) trans 0 rc 301/301 00000100:00100000:0.0:1787384846.007244:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:1.0:1787384846.012589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384846.012684:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182401920 00000100:00100000:0.0:1787384846.012694:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182401920 00000100:00100000:0.0:1787384846.012900:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:0.0:1787384846.012910:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:348c65a2-a652-4219-ac42-befa509a5d50+9:18767:x1874208182401920:12345-192.168.203.45@tcp:700:lfs.0 00000100:00100000:0.0:1787384846.013011:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:348c65a2-a652-4219-ac42-befa509a5d50+9:18767:x1874208182401920:12345-192.168.203.45@tcp:700:lfs.0 Request processed in 102us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384846.013019:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:3.0:1787384846.015350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384846.015415:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182402176 00000100:00100000:0.0:1787384846.015423:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182402176 00000100:00100000:0.0:1787384846.015562:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:0.0:1787384846.015573:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+9:18767:x1874208182402176:12345-192.168.203.45@tcp:36:lfs.0 00010000:00010000:0.0:1787384846.015628:0:25603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384846.015654:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba476c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3d44 expref: 9 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.015684:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384846.015689:0:25603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384846.015742:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.015755:0:25603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba47ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3db4 expref: 5 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.015763:0:25603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.015831:0:25603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba47ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3db4 expref: 5 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.015855:0:25603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba47ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3db4 expref: 5 pid: 22713 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384846.015890:0:25603:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:25603:1874208203488000:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384846.015978:0:25603:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384846.019314:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384846.019450:0:25603:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:25603:1874208203488000:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384846.019477:0:25603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384846.020266:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182402304 00000100:00100000:1.0:1787384846.020276:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182402304 00010000:00010000:1.0:1787384846.020373:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba47ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3db4 expref: 6 pid: 22713 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384846.020412:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:1.0:1787384846.020421:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+6:2415:x1874208182402304:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384846.020436:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384846.020443:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba47ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3db4 expref: 6 pid: 22713 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.020455:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba47ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3db4 expref: 6 pid: 22713 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.020501:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba47ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3db4 expref: 6 pid: 22713 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.020519:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384846.020525:0:22699:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.020535:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.020542:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.020574:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384846.020625:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2415:x1874208182402304:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 205us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384846.020633:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00080000:2.0:1787384846.021331:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787384846.021965:0:25603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.022030:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.022060:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5824a00/0x7ef423838fba485a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.022072:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5824a00/0x7ef423838fba485a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.022083:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5824a00/0x7ef423838fba485a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.026798:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825600/0x7ef423838fba4861 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.026821:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825600/0x7ef423838fba4861 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.026839:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825600/0x7ef423838fba4861 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384846.026866:0:25603:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e820378 reply state 00000000b86d530d transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825600/0x7ef423838fba4861 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.026878:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825600/0x7ef423838fba4861 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.026886:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:3.0:1787384846.026890:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787384846.026893:0:25603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787384846.026899:0:25603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787384846.026908:0:25603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.026914:0:25603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.026921:0:25603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.026927:0:25603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384846.026931:0:25603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.026938:0:25603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.026949:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:3.0:1787384846.026952:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384846.026961:0:25603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.026968:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4853 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384846.026990:0:25603:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e820378 reply state 00000000b86d530d transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5824a00/0x7ef423838fba485a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.026999:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5824a00/0x7ef423838fba485a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.027005:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98f8f5718600) 00010000:00010000:3.0:1787384846.027007:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787384846.027010:0:25603:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787384846.027414:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+10:18767:x1874208182402176:12345-192.168.203.45@tcp:36:lfs.0 Request processed in 11838us (12066us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787384846.027423:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 28 00010000:00010000:0.0:1787384846.199092:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384846.203210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384846.203295:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182402432 00000100:00100000:0.0:1787384846.203305:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182402432 00000100:00100000:0.0:1787384846.203357:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:0.0:1787384846.203365:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+10:18775:x1874208182402432:12345-192.168.203.45@tcp:101:lctl.0 00010000:00010000:0.0:1787384846.203386:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384846.203407:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba4868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3dde expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.203464:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba486f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.203477:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba486f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.203489:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba486f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384846.203534:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787384846.203538:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384846.203574:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba486f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.203616:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba4868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dde expref: 12 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.203633:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba486f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dde expref: 11 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.203641:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9de00) 00010000:00010000:0.0:1787384846.203644:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384846.203648:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04200, rc 0) 00000100:00100000:0.0:1787384846.203723:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+11:18775:x1874208182402432:12345-192.168.203.45@tcp:101:lctl.0 Request processed in 359us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384846.203730:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:0.0:1787384846.233605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384846.233815:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182402560 00000100:00100000:2.0:1787384846.233826:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182402560 00000100:00100000:2.0:1787384846.233894:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:2.0:1787384846.233906:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+5:18776:x1874208182402560:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384846.233928:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384846.233952:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba4876 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3de5 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.234031:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba487d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.234057:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba487d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.234069:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba487d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384846.234113:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787384846.234117:0:22714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384846.234138:0:22714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba487d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.234161:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba4876 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3de5 expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.234178:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba487d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3de5 expref: 6 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.234186:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9de00) 00010000:00010000:2.0:1787384846.234189:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384846.234192:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c0031a00, rc 0) 00000100:00100000:2.0:1787384846.234262:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84891948-9b25-4376-8d8c-2664f1d91fdc+6:18776:x1874208182402560:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 357us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384846.234269:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:3.0:1787384846.241823:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384846.242016:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182402688 00000100:00100000:0.0:1787384846.242026:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182402688 00000100:00100000:0.0:1787384846.242095:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:0.0:1787384846.242107:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84891948-9b25-4376-8d8c-2664f1d91fdc+6:18776:x1874208182402688:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384846.242127:0:25603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384846.242148:0:25603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba4884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3dec expref: -99 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242217:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba488b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242231:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba488b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242262:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba488b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242277:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4892 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242285:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242292:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242374:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cca00/0x7ef423838fba4899 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242382:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cca00/0x7ef423838fba4899 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242390:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cca00/0x7ef423838fba4899 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384846.242432:0:25603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787384846.242435:0:25603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384846.242455:0:25603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cca00/0x7ef423838fba4899 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242467:0:25603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba488b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242474:0:25603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba488b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242489:0:25603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba488b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242495:0:25603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384846.242500:0:25603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba488b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242507:0:25603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba488b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242521:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9de00) 00010000:00010000:0.0:1787384846.242525:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384846.242530:0:25603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba488b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242536:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba488b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242549:0:25603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242555:0:25603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4892 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242561:0:25603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4892 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242566:0:25603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384846.242569:0:25603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4892 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242586:0:25603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4892 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242594:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98f8f5718600) 00010000:00010000:0.0:1787384846.242596:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384846.242599:0:25603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4892 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242604:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba4892 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242628:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba4884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dec expref: 8 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242638:0:25603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cca00/0x7ef423838fba4899 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dec expref: 7 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.242645:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:0.0:1787384846.242647:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384846.242650:0:25603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cca00, rc 0) 00000100:00100000:0.0:1787384846.242821:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84891948-9b25-4376-8d8c-2664f1d91fdc+7:18776:x1874208182402688:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 672us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384846.242830:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:0.0:1787384846.253021:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384846.253148:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182402816 00000100:00100000:1.0:1787384846.253159:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182402816 00000100:00100000:1.0:1787384846.253230:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:1.0:1787384846.253241:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:84891948-9b25-4376-8d8c-2664f1d91fdc+5:18776:x1874208182402816:12345-192.168.203.45@tcp:900:lfs.0 00000100:00100000:1.0:1787384846.253318:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:84891948-9b25-4376-8d8c-2664f1d91fdc+5:18776:x1874208182402816:12345-192.168.203.45@tcp:900:lfs.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384846.253325:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00080000:0.0:1787384846.253562:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384846.258957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384846.259102:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182403072 00000100:00100000:1.0:1787384846.259112:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182403072 00000100:00100000:1.0:1787384846.259170:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00100000:1.0:1787384846.259194:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84891948-9b25-4376-8d8c-2664f1d91fdc+7:18776:x1874208182403072:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384846.259215:0:25506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384846.259234:0:25506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba48a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3df3 expref: -99 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384846.259332:0:25506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787384846.259439:0:25506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba48a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3df3 expref: 9 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.259454:0:25506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9de00) 00010000:00010000:1.0:1787384846.259457:0:25506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384846.259462:0:25506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba48a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3df3 expref: 9 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.259476:0:25506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b200, rc 0) 00000100:00100000:1.0:1787384846.259537:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84891948-9b25-4376-8d8c-2664f1d91fdc+8:18776:x1874208182403072:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 345us (590us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1787384846.259545:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00100000:1.0:1787384846.265095:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384846.265319:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182403328 00000100:00100000:3.0:1787384846.265330:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182403328 00000100:00100000:3.0:1787384846.265390:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:3.0:1787384846.265400:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84891948-9b25-4376-8d8c-2664f1d91fdc+8:18776:x1874208182403328:12345-192.168.203.45@tcp:36:lfs.0 00010000:00010000:3.0:1787384846.265457:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384846.265480:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cca00/0x7ef423838fba4899 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dec expref: 8 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.265498:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:3.0:1787384846.265503:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384846.265526:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825e00/0x7ef423838fba48ae lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.265550:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825e00/0x7ef423838fba48ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.265559:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825e00/0x7ef423838fba48ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384846.265756:0:22712:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069ce0475 reply state 00000000305619cb transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825e00/0x7ef423838fba48ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.265769:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825e00/0x7ef423838fba48ae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.265830:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:3.0:1787384846.265834:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787384846.265837:0:22712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787384846.265853:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787384846.265932:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84891948-9b25-4376-8d8c-2664f1d91fdc+9:18776:x1874208182403328:12345-192.168.203.45@tcp:36:lfs.0 Request processed in 532us (846us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787384846.265939:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:0.0:1787384846.270967:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384846.271300:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182403584 00000100:00100000:3.0:1787384846.271312:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182403584 00000100:00100000:3.0:1787384846.271371:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:3.0:1787384846.271381:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84891948-9b25-4376-8d8c-2664f1d91fdc+9:18776:x1874208182403584:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:3.0:1787384846.271596:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84891948-9b25-4376-8d8c-2664f1d91fdc+10:18776:x1874208182403584:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 215us (637us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1787384846.271604:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:1.0:1787384846.274806:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384846.279122:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182403840 00000100:00100000:0.0:1787384846.279138:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182403840 00000100:00100000:0.0:1787384846.279288:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:0.0:1787384846.279300:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+10:18776:x1874208182403840:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384846.279326:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384846.279348:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba48b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3dfa expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279423:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279438:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279449:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279461:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba48c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279469:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba48c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279476:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba48c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384846.279578:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787384846.279650:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279676:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279683:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279696:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384846.279701:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279709:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279721:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9de00) 00010000:00010000:0.0:1787384846.279724:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384846.279729:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279734:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279748:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba48c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279754:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba48c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279770:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba48c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279810:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384846.279814:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba48c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279821:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba48c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279841:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98f8f5718600) 00010000:00010000:0.0:1787384846.279852:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384846.279856:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba48c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279862:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba48c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279892:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba48b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dfa expref: 12 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279902:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9de00) 00010000:00010000:0.0:1787384846.279905:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384846.279908:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba48b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3dfa expref: 12 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.279918:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cdc00, rc 0) 00000100:00100000:0.0:1787384846.280001:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+11:18776:x1874208182403840:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 704us (5239us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1787384846.280009:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:3.0:1787384846.288043:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384846.293029:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182403968 00000100:00100000:1.0:1787384846.293047:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182403968 00000100:00100000:1.0:1787384846.293246:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 35 00000100:00100000:1.0:1787384846.293260:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84891948-9b25-4376-8d8c-2664f1d91fdc+11:18776:x1874208182403968:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384846.293286:0:25506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384846.293308:0:25506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba48d1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e01 expref: -99 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.293427:0:25506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba48d8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.293443:0:25506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba48d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.293455:0:25506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba48d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384846.293481:0:25506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787384846.293484:0:25506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384846.293503:0:25506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba48d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.293529:0:25506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba48d1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e01 expref: 13 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.293548:0:25506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba48d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e01 expref: 12 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.293557:0:25506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:1.0:1787384846.293559:0:25506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384846.293562:0:25506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ae00, rc 0) 00000100:00100000:1.0:1787384846.293629:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84891948-9b25-4376-8d8c-2664f1d91fdc+12:18776:x1874208182403968:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 373us (5598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384846.293636:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 35 00000100:00100000:3.0:1787384846.300244:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384846.300327:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182404096 00000100:00100000:1.0:1787384846.300337:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182404096 00000100:00100000:1.0:1787384846.300407:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:1.0:1787384846.300419:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84891948-9b25-4376-8d8c-2664f1d91fdc+12:18776:x1874208182404096:12345-192.168.203.45@tcp:37:lfs.0 00000100:00100000:1.0:1787384846.312334:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84891948-9b25-4376-8d8c-2664f1d91fdc+12:18776:x1874208182404096:12345-192.168.203.45@tcp:37:lfs.0 Request processed in 11905us (12088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384846.312349:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:1.0:1787384846.320420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384846.320515:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182404352 00000100:00100000:3.0:1787384846.320527:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182404352 00000100:00100000:3.0:1787384846.320588:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:3.0:1787384846.320598:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5fa2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+12:18776:x1874208182404352:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:3.0:1787384846.321037:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5fa2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+13:18776:x1874208182404352:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 372us (558us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1787384846.321047:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:2.0:1787384846.411301:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384846.411498:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182404480 00000100:00100000:0.0:1787384846.411507:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182404480 00000100:00100000:0.0:1787384846.411583:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 36 00000100:00100000:0.0:1787384846.411594:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+11:18782:x1874208182404480:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384846.411614:0:25603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384846.411632:0:25603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba48df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e08 expref: -99 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.411716:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.411731:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.411741:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.411752:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba48ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.411759:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba48ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.411765:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba48ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.411882:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba48f4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.411891:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba48f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.411899:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba48f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384846.412088:0:25603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787384846.412092:0:25603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384846.412127:0:25603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba48f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412222:0:25603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412229:0:25603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412237:0:25603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412243:0:25603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384846.412249:0:25603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412257:0:25603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412270:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9de00) 00010000:00010000:0.0:1787384846.412273:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384846.412278:0:25603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412284:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba48e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412297:0:25603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba48ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412303:0:25603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba48ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412308:0:25603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba48ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412319:0:25603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384846.412322:0:25603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba48ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412328:0:25603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba48ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412336:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98f8f5718600) 00010000:00010000:0.0:1787384846.412338:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384846.412341:0:25603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba48ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412347:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba48ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412375:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba48df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e08 expref: 13 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412388:0:25603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba48f4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e08 expref: 12 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.412395:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:0.0:1787384846.412398:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787384846.412400:0:25603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd400, rc 0) 00000100:00100000:0.0:1787384846.412466:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+12:18782:x1874208182404480:12345-192.168.203.45@tcp:101:bash.0 Request processed in 874us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384846.412474:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 36 00000100:00100000:0.0:1787384846.427066:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384846.427198:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182404608 00000100:00100000:1.0:1787384846.427208:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182404608 00000100:00100000:1.0:1787384846.427274:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:1.0:1787384846.427284:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:348c65a2-a652-4219-ac42-befa509a5d50+5:18782:x1874208182404608:12345-192.168.203.45@tcp:900:bash.0 00000100:00100000:1.0:1787384846.427367:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:348c65a2-a652-4219-ac42-befa509a5d50+5:18782:x1874208182404608:12345-192.168.203.45@tcp:900:bash.0 Request processed in 83us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384846.427374:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:1.0:1787384846.433132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384846.433214:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182404864 00000100:00100000:3.0:1787384846.433223:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182404864 00000100:00100000:3.0:1787384846.433280:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 37 00000100:00100000:3.0:1787384846.433290:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+12:18782:x1874208182404864:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:3.0:1787384846.433311:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384846.433332:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825200/0x7ef423838fba48fb lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e0f expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.433437:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.433452:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba48d8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e01 expref: 12 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.433463:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.433494:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba48d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e01 expref: 12 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384846.433507:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba48d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e01 expref: 12 pid: 25506 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384846.433533:0:22712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22712:1874208203488128:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384846.433622:0:22712:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc33b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787384846.441110:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384846.441142:0:22712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22712:1874208203488128:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384846.441171:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384846.441226:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182404992 00000100:00100000:0.0:1787384846.441544:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182404992 00010000:00010000:0.0:1787384846.441585:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba48d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e01 expref: 13 pid: 25506 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384846.441668:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:0.0:1787384846.441678:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84891948-9b25-4376-8d8c-2664f1d91fdc+13:2416:x1874208182404992:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384846.441694:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384846.441701:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba48d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e01 expref: 13 pid: 25506 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.441715:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba48d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e01 expref: 13 pid: 25506 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.441738:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba48d8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e01 expref: 13 pid: 25506 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.441753:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:0.0:1787384846.441758:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.441768:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.441775:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.441862:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384846.441926:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84891948-9b25-4376-8d8c-2664f1d91fdc+12:2416:x1874208182404992:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 249us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384846.441948:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 16 00010000:00010000:2.0:1787384846.442001:0:22712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442021:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442060:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031400/0x7ef423838fba4909 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442070:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031400/0x7ef423838fba4909 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442077:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031400/0x7ef423838fba4909 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442673:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4910 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442684:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4910 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442691:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4910 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384846.442702:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787384846.442728:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442734:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442740:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442746:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384846.442758:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442765:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442813:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:2.0:1787384846.442817:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384846.442821:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442827:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825000/0x7ef423838fba4902 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384846.442839:0:22712:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6a95303 reply state 0000000066836c49 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031400/0x7ef423838fba4909 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442859:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031400/0x7ef423838fba4909 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442865:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff98f8e8aa4e00) 00010000:00010000:2.0:1787384846.442867:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384846.442877:0:22712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787384846.442911:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825200/0x7ef423838fba48fb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e0f expref: 15 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442925:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4910 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e0f expref: 14 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.442932:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384846.442935:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787384846.442943:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c0031c00, rc 0) 00000100:00100000:2.0:1787384846.442998:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+15:18782:x1874208182404864:12345-192.168.203.45@tcp:101:bash.0 Request processed in 9709us (9874us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1787384846.443006:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 37 00000100:00100000:2.0:1787384846.457857:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384846.457940:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182405120 00000100:00100000:0.0:1787384846.457949:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182405120 00000100:00100000:0.0:1787384846.458066:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 38 00000100:00100000:0.0:1787384846.458077:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+15:18782:x1874208182405120:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384846.458100:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384846.458120:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba491e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e16 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.458655:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4925 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.458681:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4925 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.458693:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4925 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384846.458746:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787384846.458750:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384846.459183:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4925 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.459200:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4925 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.459232:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba491e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e16 expref: 17 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.459253:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4925 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e16 expref: 16 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.459408:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384846.459411:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384846.459415:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cce00, rc 0) 00000100:00100000:0.0:1787384846.459489:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+16:18782:x1874208182405120:12345-192.168.203.45@tcp:101:bash.0 Request processed in 1414us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384846.459498:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 38 00000100:00100000:3.0:1787384846.471526:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384846.471618:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182405376 00000100:00100000:1.0:1787384846.471627:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182405376 00000100:00100000:1.0:1787384846.471682:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:1.0:1787384846.471692:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+16:18782:x1874208182405376:12345-192.168.203.45@tcp:35:bash.0 00000100:00100000:1.0:1787384846.472261:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+17:18782:x1874208182405376:12345-192.168.203.45@tcp:35:bash.0 Request processed in 567us (739us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1787384846.472270:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:3.0:1787384846.585332:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384846.585462:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182405632 00000100:00100000:0.0:1787384846.585473:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182405632 00000100:00100000:0.0:1787384846.585548:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 39 00000100:00100000:0.0:1787384846.585559:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+17:18792:x1874208182405632:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384846.585584:0:25603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384846.585604:0:25603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba492c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e1d expref: -99 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384846.585716:0:25603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787384846.586049:0:25603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba492c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e1d expref: 19 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.586064:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9de00) 00010000:00010000:0.0:1787384846.586067:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384846.586071:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba492c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e1d expref: 19 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.586084:0:25603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc600, rc 0) 00000100:00100000:0.0:1787384846.586157:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+18:18792:x1874208182405632:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 600us (834us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1787384846.586182:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 39 00000100:00100000:3.0:1787384846.592562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384846.592851:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182405888 00000100:00100000:1.0:1787384846.592860:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182405888 00000100:00100000:1.0:1787384846.593037:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:1.0:1787384846.593049:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+18:18792:x1874208182405888:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:1.0:1787384846.593289:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+19:18792:x1874208182405888:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 242us (735us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1787384846.593297:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:3.0:1787384846.687847:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384846.687918:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182406144 00000100:00100000:2.0:1787384846.687928:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182406144 00000100:00100000:2.0:1787384846.687991:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 40 00000100:00100000:2.0:1787384846.688001:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+19:18795:x1874208182406144:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384846.688026:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384846.688045:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba493a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e24 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.688296:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4941 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.688310:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4941 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.688321:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4941 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384846.688333:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787384846.688437:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba493a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e24 expref: 22 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.688454:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4941 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e24 expref: 21 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384846.688478:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384846.688481:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384846.688484:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c0030c00, rc 0) 00000100:00100000:2.0:1787384846.688554:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+21:18795:x1874208182406144:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 554us (724us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1787384846.688560:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 40 00000100:00100000:3.0:1787384846.703514:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384846.703941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384846.704059:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182406272 00000100:00100000:1.0:1787384846.704069:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182406272 00000100:00100000:1.0:1787384846.704128:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 41 00000100:00100000:1.0:1787384846.704138:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348c65a2-a652-4219-ac42-befa509a5d50+21:18795:x1874208182406272:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:1.0:1787384846.704203:0:25506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba494f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.704220:0:25506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba494f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.704232:0:25506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba494f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.704268:0:25506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba494f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.704275:0:25506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba494f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.704283:0:25506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba494f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.704289:0:25506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384846.704294:0:25506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba494f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.704302:0:25506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba494f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.704327:0:25506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:1.0:1787384846.704330:0:25506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384846.704335:0:25506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba494f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384846.704342:0:25506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba494f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384846.704424:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348c65a2-a652-4219-ac42-befa509a5d50+21:18795:x1874208182406272:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 287us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384846.704431:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 41 00000040:00080000:2.0:1787384846.711655:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787384846.712163:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182406400 00000100:00100000:0.0:1787384846.712173:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182406400 00000040:00080000:3.0:1787384846.712277:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787384846.712466:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:0.0:1787384846.712476:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:348c65a2-a652-4219-ac42-befa509a5d50+21:2416:x1874208182406400:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384846.712495:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384846.712519:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4941 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e24 expref: 21 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384846.712601:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384846.712607:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384846.712727:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:348c65a2-a652-4219-ac42-befa509a5d50+20:2416:x1874208182406400:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 251us (8785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384846.712735:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:1.0:1787384846.719591:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384846.722116:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182406656 00000100:00100000:2.0:1787384846.722132:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182406656 00000100:00100000:2.0:1787384846.722235:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:2.0:1787384846.722246:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348c65a2-a652-4219-ac42-befa509a5d50+20:18795:x1874208182406656:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:2.0:1787384846.722465:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348c65a2-a652-4219-ac42-befa509a5d50+21:18795:x1874208182406656:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 221us (2883us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1787384846.722473:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:1.0:1787384847.120081:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384847.120522:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182406912 00000100:00100000:2.0:1787384847.120531:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182406912 00000100:00100000:2.0:1787384847.120604:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 42 00000100:00100000:2.0:1787384847.120614:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+21:18827:x1874208182406912:12345-192.168.203.45@tcp:101:cat.0 00010000:00010000:2.0:1787384847.120637:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384847.120656:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4956 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e2b expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.121006:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba495d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.121039:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba495d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.121053:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba495d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384847.121065:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787384847.121191:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4956 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e2b expref: 24 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.121214:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba495d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e2b expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.121223:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384847.121226:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384847.121230:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c0030800, rc 0) 00000100:00100000:2.0:1787384847.121295:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+23:18827:x1874208182406912:12345-192.168.203.45@tcp:101:cat.0 Request processed in 683us (1224us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1787384847.121304:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 42 00000100:00080000:0.0:1787384847.121971:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384847.126194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384847.126237:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384847.126319:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182407168 00000100:00100000:1.0:1787384847.126331:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182407168 00000100:00100000:1.0:1787384847.126392:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:1.0:1787384847.126404:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+23:18827:x1874208182407168:12345-192.168.203.45@tcp:35:cat.0 00000100:00100000:1.0:1787384847.126672:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+24:18827:x1874208182407168:12345-192.168.203.45@tcp:35:cat.0 Request processed in 270us (487us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1787384847.126680:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:0.0:1787384847.128140:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182407296 00000100:00100000:0.0:1787384847.128150:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182407296 00000100:00100000:0.0:1787384847.128212:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 1 00000100:00100000:0.0:1787384847.128220:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:348c65a2-a652-4219-ac42-befa509a5d50+24:2413:x1874208182407296:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384847.128233:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384847.128255:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba495d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e2b expref: 24 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384847.128273:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384847.128278:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384847.128319:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:348c65a2-a652-4219-ac42-befa509a5d50+23:2413:x1874208182407296:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 100us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384847.128340:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 1 00000100:00100000:3.0:1787384847.205849:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384847.205894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384847.205920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384847.205953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384847.205987:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182407680 00000100:00100000:3.0:1787384847.205996:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182407680 00000100:00100000:1.0:1787384847.206006:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182407936 00000100:00100000:1.0:1787384847.206010:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182407936 00000100:00100000:3.0:1787384847.206042:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182408192 00000100:00100000:3.0:1787384847.206045:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182408192 00000100:00100000:1.0:1787384847.206048:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 61 00000100:00100000:1.0:1787384847.206056:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84891948-9b25-4376-8d8c-2664f1d91fdc+12:2416:x1874208182407936:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384847.206064:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:3.0:1787384847.206070:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:2416:x1874208182407680:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384847.206145:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182407424 00000100:00100000:0.0:1787384847.206147:0:24638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:2.0:1787384847.206149:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182407424 00000100:00100000:0.0:1787384847.206156:0:24638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2416:x1874208182408192:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384847.206177:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 166 00000100:00100000:2.0:1787384847.206183:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+13:2416:x1874208182407424:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384847.206211:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84891948-9b25-4376-8d8c-2664f1d91fdc+12:2416:x1874208182407936:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 155us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384847.206234:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 61 00000100:00080000:1.0:1787384847.206292:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384847.207765:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:2416:x1874208182407680:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 1678us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384847.207802:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:0.0:1787384847.216214:0:24638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2416:x1874208182408192:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 10048us (10248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384847.216228:0:24638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:2.0:1787384847.224290:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+13:2416:x1874208182407424:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 18092us (18445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384847.224308:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 166 00000100:00100000:1.0:1787384847.229257:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384847.229423:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384847.229519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384847.230210:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182407808 00000100:00100000:3.0:1787384847.230222:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182407808 00000100:00100000:3.0:1787384847.230287:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 26 00000100:00100000:3.0:1787384847.230299:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:348c65a2-a652-4219-ac42-befa509a5d50+5:2416:x1874208182407808:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384847.230381:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:348c65a2-a652-4219-ac42-befa509a5d50+5:2416:x1874208182407808:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 85us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384847.230389:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 26 00000100:00080000:3.0:1787384847.230498:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384847.232374:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182407552 00000100:00100000:0.0:1787384847.232388:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182407552 00000100:00080000:0.0:1787384847.232421:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384847.232461:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182408064 00000100:00100000:0.0:1787384847.232465:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182408064 00010000:00010000:2.0:1787384847.232480:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384847.232494:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:0.0:1787384847.232502:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+5:2416:x1874208182407552:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384847.232584:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+5:2416:x1874208182407552:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 82us (3335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384847.232590:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:0.0:1787384847.232608:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:0.0:1787384847.232615:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2416:x1874208182408064:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384847.232640:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2416:x1874208182408064:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 25us (3120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384847.232645:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:1.0:1787384847.235102:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384847.236638:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182408320 00000100:00100000:3.0:1787384847.236654:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182408320 00000100:00100000:3.0:1787384847.236747:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:3.0:1787384847.236771:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2416:x1874208182408320:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384847.236885:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2416:x1874208182408320:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 117us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384847.236893:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00080000:0.0:1787384847.237025:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384847.266530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384847.266646:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182408576 00000100:00100000:1.0:1787384847.266656:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182408576 00000100:00100000:1.0:1787384847.266728:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:1.0:1787384847.266739:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348c65a2-a652-4219-ac42-befa509a5d50+23:18833:x1874208182408576:12345-192.168.203.45@tcp:101:dd.0 00010000:00010000:1.0:1787384847.266773:0:25506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384847.266830:0:25506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba496b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e32 expref: -99 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.266972:0:25506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba4972 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.266986:0:25506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba4972 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.266999:0:25506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba4972 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384847.267025:0:25506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787384847.267453:0:25506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba496b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e32 expref: 26 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.267474:0:25506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba4972 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e32 expref: 25 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.267497:0:25506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:1.0:1787384847.267500:0:25506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384847.267504:0:25506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a600, rc 0) 00000100:00100000:1.0:1787384847.267572:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348c65a2-a652-4219-ac42-befa509a5d50+25:18833:x1874208182408576:12345-192.168.203.45@tcp:101:dd.0 Request processed in 834us (1052us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1787384847.267581:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:2.0:1787384847.274773:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384847.274852:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384847.274986:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182408704 00000100:00100000:0.0:1787384847.274995:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182408704 00000100:00100000:0.0:1787384847.275052:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 44 00000100:00100000:0.0:1787384847.275074:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+25:18833:x1874208182408704:12345-192.168.203.45@tcp:101:dd.0 00010000:00010000:0.0:1787384847.275097:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384847.275115:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba4980 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e39 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384847.275159:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cde00/0x7ef423838fba4987 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384847.275172:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cde00/0x7ef423838fba4987 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384847.275182:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cde00/0x7ef423838fba4987 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384847.275300:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba4980 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e39 expref: 27 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384847.275318:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cde00/0x7ef423838fba4987 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e39 expref: 26 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384847.275327:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384847.275329:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384847.275333:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cde00, rc 0) 00000100:00100000:0.0:1787384847.275393:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+26:18833:x1874208182408704:12345-192.168.203.45@tcp:101:dd.0 Request processed in 320us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384847.275400:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 44 00000100:00100000:1.0:1787384847.277282:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182408832 00000100:00100000:1.0:1787384847.277294:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182408832 00000100:00100000:0.0:1787384847.277419:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:0.0:1787384847.277429:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:348c65a2-a652-4219-ac42-befa509a5d50+26:2413:x1874208182408832:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384847.277458:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384847.277480:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba4972 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e32 expref: 26 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384847.277498:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384847.277503:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384847.277560:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:348c65a2-a652-4219-ac42-befa509a5d50+25:2413:x1874208182408832:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 132us (2707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384847.277567:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:2.0:1787384847.287380:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384847.288409:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182409088 00000100:00100000:3.0:1787384847.288422:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182409088 00000100:00100000:3.0:1787384847.288547:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 45 00000100:00100000:3.0:1787384847.288558:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+25:18833:x1874208182409088:12345-192.168.203.45@tcp:36:dd.0 00010000:00010000:3.0:1787384847.288610:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384847.288637:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4925 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e16 expref: 25 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384847.288768:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:3.0:1787384847.288774:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384847.289500:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39000/0x7ef423838fba498e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384847.289519:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39000/0x7ef423838fba498e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384847.289550:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39000/0x7ef423838fba498e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384847.289621:0:22713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1787384847.290027:0:22713:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046c2e203 reply state 000000000e4c6337 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39000/0x7ef423838fba498e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384847.290043:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39000/0x7ef423838fba498e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384847.290051:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:3.0:1787384847.290054:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787384847.290058:0:22713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384847.294650:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+27:18833:x1874208182409088:12345-192.168.203.45@tcp:36:dd.0 Request processed in 6081us (7865us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1787384847.294677:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 45 00000020:00080000:3.0:1787384847.294686:0:22713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787384847.463882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384847.464240:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182409344 00000100:00100000:2.0:1787384847.464252:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182409344 00000100:00100000:2.0:1787384847.464313:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:2.0:1787384847.464324:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348c65a2-a652-4219-ac42-befa509a5d50+27:18833:x1874208182409344:12345-192.168.203.45@tcp:35:dd.0 00000100:00100000:2.0:1787384847.464558:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348c65a2-a652-4219-ac42-befa509a5d50+28:18833:x1874208182409344:12345-192.168.203.45@tcp:35:dd.0 Request processed in 234us (682us total) trans 12884901907 rc 0/0 00000100:00100000:2.0:1787384847.464566:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:1.0:1787384847.668943:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384847.669043:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182409472 00000100:00100000:2.0:1787384847.669051:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182409472 00000100:00100000:2.0:1787384847.669111:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:2.0:1787384847.669122:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348c65a2-a652-4219-ac42-befa509a5d50+28:18847:x1874208182409472:12345-192.168.203.45@tcp:101:stat.0 00010000:00010000:2.0:1787384847.669146:0:25506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384847.669167:0:25506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba4995 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e40 expref: -99 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669230:0:25506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba499c lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669243:0:25506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba499c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669254:0:25506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba499c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669266:0:25506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba49a3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669291:0:25506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba49a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669298:0:25506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba49a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669381:0:25506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba49aa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669391:0:25506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba49aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669399:0:25506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba49aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384847.669441:0:25506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787384847.669446:0:25506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384847.669478:0:25506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba49aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669490:0:25506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba49aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669498:0:25506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba499c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669504:0:25506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba499c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669510:0:25506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba499c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669526:0:25506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384847.669531:0:25506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba499c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669543:0:25506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba499c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669557:0:25506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:2.0:1787384847.669559:0:25506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384847.669564:0:25506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba499c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669569:0:25506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba499c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669584:0:25506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba49a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669589:0:25506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba49a3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669594:0:25506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba49a3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669598:0:25506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384847.669600:0:25506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba49a3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669606:0:25506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba49a3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669625:0:25506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff98f8e8aa4e00) 00010000:00010000:2.0:1787384847.669627:0:25506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384847.669630:0:25506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba49a3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669635:0:25506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba49a3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669663:0:25506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba4995 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e40 expref: 30 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669681:0:25506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba49aa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e40 expref: 29 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.669689:0:25506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384847.669691:0:25506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384847.669694:0:25506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c0030800, rc 0) 00000100:00100000:2.0:1787384847.669756:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348c65a2-a652-4219-ac42-befa509a5d50+29:18847:x1874208182409472:12345-192.168.203.45@tcp:101:stat.0 Request processed in 635us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384847.669763:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:3.0:1787384847.757815:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384847.757929:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182409728 00000100:00100000:2.0:1787384847.757941:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182409728 00000100:00100000:2.0:1787384847.758004:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 47 00000100:00100000:2.0:1787384847.758013:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+29:18853:x1874208182409728:12345-192.168.203.45@tcp:36:truncate.0 00010000:00010000:2.0:1787384847.758064:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384847.758089:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba49aa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e40 expref: 29 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.758125:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384847.758130:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384847.758320:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba49b1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.758335:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba49b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.758346:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba49b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787384847.758390:0:22714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:2.0:1787384847.758415:0:22714:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e048f42d reply state 0000000079eb6bc9 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba49b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.758426:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba49b1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384847.758432:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384847.758435:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384847.758437:0:22714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384847.758542:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+31:18853:x1874208182409728:12345-192.168.203.45@tcp:36:truncate.0 Request processed in 530us (771us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1787384847.758550:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 47 00000020:00080000:2.0:1787384847.758555:0:22714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787384847.799056:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384847.799079:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203488256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384847.799149:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384847.799198:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203488256 00000100:00100000:1.0:1787384847.799206:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203488256 00000100:00100000:1.0:1787384847.799273:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384847.799283:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203488256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384847.799310:0:25681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787384847.799352:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203488256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384847.799360:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384847.799410:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203488256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787384847.800932:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384847.801042:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203488384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384847.801095:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384847.801448:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203488384 00000100:00100000:0.0:1787384847.801455:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203488384 00000100:00100000:0.0:1787384847.801513:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787384847.801522:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203488384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787384847.801540:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384847.801580:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203488384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384847.801587:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787384847.801624:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203488384:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787384847.801760:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384847.992710:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384847.992884:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182409856 00000100:00100000:1.0:1787384847.992894:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182409856 00000100:00100000:1.0:1787384847.992956:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 48 00000100:00100000:1.0:1787384847.992974:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+31:18867:x1874208182409856:12345-192.168.203.45@tcp:101:stat.0 00010000:00010000:1.0:1787384847.993013:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384847.993034:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba49b8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e47 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993108:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba49bf lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993122:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba49bf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993134:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba49bf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993146:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba49c6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993153:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba49c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993161:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba49c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993246:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993256:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993263:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384847.993305:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787384847.993316:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384847.993341:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993352:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993360:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba49bf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993366:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba49bf lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993373:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba49bf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993379:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384847.993383:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba49bf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993393:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba49bf lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993404:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:1.0:1787384847.993407:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384847.993411:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba49bf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993417:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba49bf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993430:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba49c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993447:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba49c6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993453:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba49c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993458:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384847.993461:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba49c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993467:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba49c6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993475:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff98f8e8aa4e00) 00010000:00010000:1.0:1787384847.993478:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384847.993481:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba49c6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993486:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba49c6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993516:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba49b8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e47 expref: 33 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993529:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e47 expref: 32 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384847.993537:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:1.0:1787384847.993540:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384847.993548:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a600, rc 0) 00000100:00100000:1.0:1787384847.993612:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+32:18867:x1874208182409856:12345-192.168.203.45@tcp:101:stat.0 Request processed in 647us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384847.993621:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 48 00000100:00100000:1.0:1787384848.118003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.118196:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182410112 00000100:00100000:0.0:1787384848.118205:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182410112 00000100:00100000:0.0:1787384848.118272:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 49 00000100:00100000:0.0:1787384848.118283:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+32:18877:x1874208182410112:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384848.118303:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384848.118323:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba49d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e4e expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384848.118440:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787384848.118711:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba49d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e4e expref: 34 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.118725:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9de00) 00010000:00010000:0.0:1787384848.118728:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384848.118732:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba49d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e4e expref: 34 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.118746:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc600, rc 0) 00000100:00100000:0.0:1787384848.119193:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+33:18877:x1874208182410112:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 910us (1197us total) trans 12884901910 rc 301/301 00000100:00100000:0.0:1787384848.119201:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 49 00000100:00100000:2.0:1787384848.138699:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384848.139086:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182410368 00000100:00100000:3.0:1787384848.139107:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182410368 00000100:00100000:3.0:1787384848.139184:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:3.0:1787384848.139196:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dedc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+33:18877:x1874208182410368:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:3.0:1787384848.139496:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dedc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+34:18877:x1874208182410368:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 301us (811us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1787384848.139505:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:3.0:1787384848.234245:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.234372:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182410624 00000100:00100000:0.0:1787384848.234384:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182410624 00000100:00100000:0.0:1787384848.234460:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 50 00000100:00100000:0.0:1787384848.234470:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+34:18883:x1874208182410624:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384848.234508:0:25603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384848.234535:0:25603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba49e2 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e55 expref: -99 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.234710:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.234730:0:25603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4910 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e0f expref: 35 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.234764:0:25603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e47 expref: 35 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.234774:0:25603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.234870:0:25603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e47 expref: 35 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.234886:0:25603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e47 expref: 35 pid: 22713 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384848.234903:0:25603:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:25603:1874208203488512:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384848.235029:0:25603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4910 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e0f expref: 35 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.235038:0:25603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4910 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e0f expref: 35 pid: 22712 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384848.235048:0:25603:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:25603:1874208203488640:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384848.235074:0:25603:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384848.248152:0:25603:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:25603:1874208203488512:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384848.248169:0:25603:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:25603:1874208203488640:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384848.248209:0:25603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.248289:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384848.254376:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384848.254488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384848.254726:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182410752 00000100:00100000:1.0:1787384848.254740:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182410752 00010000:00010000:1.0:1787384848.254855:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e47 expref: 36 pid: 22713 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384848.254901:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182410880 00000100:00100000:1.0:1787384848.254905:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182410880 00010000:00010000:1.0:1787384848.254924:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4910 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e0f expref: 37 pid: 22712 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384848.254941:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:1.0:1787384848.254963:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c405d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:348c65a2-a652-4219-ac42-befa509a5d50+37:2416:x1874208182410752:12345-192.168.203.45@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787384848.254964:0:22697:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787384848.254976:0:22697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787384848.254982:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384848.254990:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e47 expref: 37 pid: 22713 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.255004:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e47 expref: 37 pid: 22713 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.255033:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba49cd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e47 expref: 37 pid: 22713 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.255052:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:1.0:1787384848.255075:0:22698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.255087:0:22698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.255094:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384848.255181:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c405d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:348c65a2-a652-4219-ac42-befa509a5d50+36:2416:x1874208182410752:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 229us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384848.255189:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:1.0:1787384848.255258:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:1.0:1787384848.255265:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:348c65a2-a652-4219-ac42-befa509a5d50+35:2416:x1874208182410880:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384848.255273:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384848.255278:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4910 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e0f expref: 35 pid: 22712 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.255287:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4910 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e0f expref: 35 pid: 22712 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.255299:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4910 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e0f expref: 35 pid: 22712 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.255310:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:1.0:1787384848.255313:0:22698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.255321:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.255339:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.255372:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384848.255394:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:348c65a2-a652-4219-ac42-befa509a5d50+34:2416:x1874208182410880:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 129us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384848.255401:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 18 00010000:00010000:3.0:1787384848.255554:0:25603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.255563:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384848.255587:0:25603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1787384848.255880:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba49e2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e55 expref: 35 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.255896:0:25603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e55 expref: 34 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.255904:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:3.0:1787384848.255912:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787384848.255915:0:25603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58ccc00, rc 0) 00000100:00100000:3.0:1787384848.255958:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+34:18883:x1874208182410624:12345-192.168.203.45@tcp:101:bash.0 Request processed in 21489us (21726us total) trans 12884901912 rc 0/0 00000100:00100000:3.0:1787384848.255967:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 50 00000100:00100000:1.0:1787384848.259596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384848.260941:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182411136 00000100:00100000:3.0:1787384848.260970:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182411136 00000100:00100000:3.0:1787384848.261079:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 51 00000100:00100000:3.0:1787384848.261092:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+34:18883:x1874208182411136:12345-192.168.203.45@tcp:36:bash.0 00010000:00010000:3.0:1787384848.261417:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38000/0x7ef423838fba49f7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.261440:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38000/0x7ef423838fba49f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.261455:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38000/0x7ef423838fba49f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384848.261509:0:22713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:3.0:1787384848.261534:0:22713:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b365018f reply state 000000000b9d2289 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38000/0x7ef423838fba49f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.261550:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38000/0x7ef423838fba49f7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.261558:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:3.0:1787384848.261562:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787384848.261566:0:22713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384848.261702:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+37:18883:x1874208182411136:12345-192.168.203.45@tcp:36:bash.0 Request processed in 611us (2119us total) trans 12884901914 rc 0/0 00000100:00100000:3.0:1787384848.261733:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 51 00000020:00080000:3.0:1787384848.261740:0:22713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787384848.269549:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.269662:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182411264 00000100:00100000:0.0:1787384848.269676:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182411264 00000100:00100000:0.0:1787384848.269774:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:0.0:1787384848.269840:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+37:18883:x1874208182411264:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384848.269872:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384848.269907:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd200/0x7ef423838fba49fe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e5c expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.270162:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd200/0x7ef423838fba49fe lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e5c expref: 38 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.270181:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd200/0x7ef423838fba49fe lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e5c expref: 38 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.270206:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384848.270210:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384848.270215:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd200, rc 0) 00000100:00100000:0.0:1787384848.270352:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+38:18883:x1874208182411264:12345-192.168.203.45@tcp:101:bash.0 Request processed in 532us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384848.270359:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:0.0:1787384848.281270:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384848.281358:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182411392 00000100:00100000:3.0:1787384848.281371:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182411392 00000100:00100000:3.0:1787384848.281448:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:3.0:1787384848.281458:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+38:18883:x1874208182411392:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:3.0:1787384848.281484:0:25603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384848.281510:0:25603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38800/0x7ef423838fba4a05 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e63 expref: -99 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.282079:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a0c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.282100:0:25603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e55 expref: 39 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.282109:0:25603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a0c lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.282153:0:25603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e55 expref: 39 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.282169:0:25603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e55 expref: 39 pid: 25603 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384848.282186:0:25603:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:25603:1874208203488768:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384848.282343:0:25603:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d97cc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384848.287280:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384848.287410:0:25603:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:25603:1874208203488768:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384848.287446:0:25603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a0c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384848.287771:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182411520 00000100:00100000:0.0:1787384848.287814:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182411520 00010000:00010000:0.0:1787384848.287874:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e55 expref: 40 pid: 25603 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384848.287922:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:0.0:1787384848.287934:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:348c65a2-a652-4219-ac42-befa509a5d50+40:2415:x1874208182411520:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384848.288126:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384848.288154:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e55 expref: 40 pid: 25603 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.288167:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e55 expref: 40 pid: 25603 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.288197:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba49e9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e55 expref: 40 pid: 25603 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.288217:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384848.288222:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a0c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.288235:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a0c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.288242:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a0c lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.288321:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384848.288400:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:348c65a2-a652-4219-ac42-befa509a5d50+39:2415:x1874208182411520:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 468us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384848.288409:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 19 00010000:00010000:3.0:1787384848.290145:0:25603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a0c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.290165:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a0c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384848.290247:0:25603:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787384848.290253:0:25603:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384848.290281:0:25603:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a0c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.290333:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38800/0x7ef423838fba4a05 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e63 expref: 39 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.290356:0:25603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a0c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e63 expref: 38 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.290365:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:3.0:1787384848.290368:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384848.290372:0:25603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8cad39a00, rc 0) 00000100:00100000:3.0:1787384848.290460:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+38:18883:x1874208182411392:12345-192.168.203.45@tcp:101:bash.0 Request processed in 9001us (9202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384848.290469:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:1.0:1787384848.295403:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384848.295512:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182411776 00000100:00100000:3.0:1787384848.295525:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182411776 00000100:00100000:3.0:1787384848.296078:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:3.0:1787384848.296109:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:348c65a2-a652-4219-ac42-befa509a5d50+38:18883:x1874208182411776:12345-192.168.203.45@tcp:103:bash.0 00010000:00010000:3.0:1787384848.296128:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787384848.296159:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd200/0x7ef423838fba49fe lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e5c expref: 38 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.296185:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a0c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e63 expref: 37 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.296198:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:3.0:1787384848.296204:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384848.296278:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:348c65a2-a652-4219-ac42-befa509a5d50+36:18883:x1874208182411776:12345-192.168.203.45@tcp:103:bash.0 Request processed in 173us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384848.296286:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:0.0:1787384848.299934:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384848.300135:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182411904 00000100:00100000:2.0:1787384848.300148:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182411904 00000100:00100000:2.0:1787384848.300260:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:2.0:1787384848.300272:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+36:18883:x1874208182411904:12345-192.168.203.45@tcp:58:bash.0 00010000:00010000:2.0:1787384848.300434:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4a13 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.300455:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4a13 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.300470:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4a13 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384848.302377:0:22714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384848.302416:0:22714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1787384848.303310:0:22714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1787384848.303515:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+36:18883:x1874208182411904:12345-192.168.203.45@tcp:58:bash.0 Request processed in 3236us (3766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384848.303528:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:1.0:1787384848.306306:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.306429:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182412032 00000100:00100000:0.0:1787384848.306441:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182412032 00000100:00100000:0.0:1787384848.306559:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 55 00000100:00100000:0.0:1787384848.306573:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+36:18883:x1874208182412032:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384848.306602:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384848.306656:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba4a1a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e6a expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.306729:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4a13 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.306742:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba4a1a lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e6a expref: 37 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.306775:0:22712:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4a13 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.307097:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba4a1a lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e6a expref: 37 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.307112:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384848.307115:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384848.307119:0:22712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba4a1a lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e6a expref: 37 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.307127:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58ccc00, rc 0) 00000100:00100000:0.0:1787384848.307205:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+37:18883:x1874208182412032:12345-192.168.203.45@tcp:101:bash.0 Request processed in 636us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384848.307214:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 55 00000040:00080000:3.0:1787384848.759080:0:22748:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787384848.759093:0:22748:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384848.759129:0:22748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787384848.759141:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787384848.759372:0:22748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22748:1874208203488896:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787384848.759498:0:22748:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d97ccc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384848.768582:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384848.768871:0:22748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22748:1874208203488896:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787384848.769075:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182412160 00000100:00100000:0.0:1787384848.769086:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182412160 00000100:00100000:0.0:1787384848.769168:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:0.0:1787384848.769181:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+37:18884:x1874208182412160:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787384848.769227:0:25603:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787384848.769405:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+37:18884:x1874208182412160:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 226us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384848.769414:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:1.0:1787384848.776321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384848.777112:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182412288 00000100:00100000:2.0:1787384848.777127:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182412288 00000100:00100000:2.0:1787384848.777213:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:2.0:1787384848.777225:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+37:18884:x1874208182412288:12345-192.168.203.45@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787384848.777321:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba4a21 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.777341:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba4a21 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.777355:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba4a21 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.781047:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4a28 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.781073:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4a28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.781086:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4a28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.781118:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba4a2f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.781651:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba4a2f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.781664:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba4a2f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384848.781722:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787384848.781726:0:22714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384848.781743:0:22714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba4a2f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.781756:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba4a21 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.781762:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba4a21 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.781768:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba4a21 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.781818:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384848.781823:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba4a21 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782809:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba4a21 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782835:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9d600) 00010000:00010000:2.0:1787384848.782841:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384848.782847:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba4a21 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782854:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba4a21 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782874:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4a28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782881:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4a28 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782887:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4a28 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782892:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384848.782896:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4a28 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782901:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4a28 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782924:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff98f8e8aa4f00) 00010000:00010000:2.0:1787384848.782926:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384848.782930:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4a28 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782935:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba4a28 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782952:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba4a2f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782958:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba4a2f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782964:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba4a2f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782969:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384848.782972:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba4a2f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782978:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba4a2f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782986:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384848.782989:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384848.782991:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba4a2f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.782997:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030800/0x7ef423838fba4a2f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384848.783109:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+37:18884:x1874208182412288:12345-192.168.203.45@tcp:34:lhsmtool_posix.0 Request processed in 5882us (6800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384848.783120:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:1.0:1787384848.792507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384848.792664:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182412544 00000100:00100000:2.0:1787384848.792679:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182412544 00000100:00100000:2.0:1787384848.792766:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00100000:2.0:1787384848.792804:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+37:18884:x1874208182412544:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384848.792841:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384848.792871:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4a36 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e71 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.793155:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4a3d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.793175:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4a3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.793189:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4a3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384848.793201:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787384848.793315:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4a3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.793324:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4a3d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.793330:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4a3d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.793359:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c148c200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384848.793365:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4a3d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.793373:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4a3d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.793390:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384848.793393:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384848.793398:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4a3d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.793405:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4a3d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.793463:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4a36 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e71 expref: 39 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.793476:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9d600) 00010000:00010000:2.0:1787384848.793478:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384848.793482:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4a36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e71 expref: 39 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.793494:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c148d800, rc 0) 00000100:00100000:2.0:1787384848.793583:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+38:18884:x1874208182412544:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 806us (1091us total) trans 12884901915 rc 301/301 00000100:00100000:2.0:1787384848.793593:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00100000:1.0:1787384848.800021:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384848.800142:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182412672 00000100:00100000:2.0:1787384848.800173:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182412672 00000100:00100000:2.0:1787384848.800245:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:2.0:1787384848.800257:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348c65a2-a652-4219-ac42-befa509a5d50+38:18884:x1874208182412672:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787384848.800304:0:25506:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787384848.800485:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348c65a2-a652-4219-ac42-befa509a5d50+38:18884:x1874208182412672:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 229us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384848.800494:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:0.0:1787384848.803664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384848.803762:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182412928 00000100:00100000:2.0:1787384848.803775:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182412928 00000100:00100000:2.0:1787384848.803885:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:2.0:1787384848.803897:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+38:18884:x1874208182412928:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384848.803925:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384848.803950:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c800/0x7ef423838fba4a4b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e78 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384848.804462:0:22714:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:2.0:1787384848.804472:0:22714:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:2.0:1787384848.804501:0:22714:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1787384848.804691:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148da00/0x7ef423838fba4a52 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.804708:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148da00/0x7ef423838fba4a52 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.804722:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148da00/0x7ef423838fba4a52 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.804855:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c800/0x7ef423838fba4a4b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e78 expref: 41 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.804900:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148da00/0x7ef423838fba4a52 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e78 expref: 40 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.804910:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98f8e8aa4600) 00010000:00010000:2.0:1787384848.804913:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384848.804916:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c148da00, rc 0) 00000100:00100000:2.0:1787384848.804995:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+40:18884:x1874208182412928:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 1098us (1343us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1787384848.805006:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:2.0:1787384848.817175:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384848.818419:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182413184 00000100:00100000:3.0:1787384848.818436:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182413184 00000100:00100000:3.0:1787384848.818518:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 61 00000100:00100000:3.0:1787384848.818529:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+40:18884:x1874208182413184:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787384848.818621:0:25603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384848.818656:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148da00/0x7ef423838fba4a52 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e78 expref: 40 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.818701:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98f8e8aa4600) 00010000:00010000:3.0:1787384848.818715:0:25603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384848.818746:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39800/0x7ef423838fba4a60 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.818763:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39800/0x7ef423838fba4a60 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.818774:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39800/0x7ef423838fba4a60 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.819613:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a67 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x39804225 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.819627:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a67 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x39804225 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.819636:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a67 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x39804225 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.819721:0:25603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39800/0x7ef423838fba4a60 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820006:0:25603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39800/0x7ef423838fba4a60 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820016:0:25603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39800/0x7ef423838fba4a60 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820023:0:25603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8cad39800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384848.820027:0:25603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39800/0x7ef423838fba4a60 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820037:0:25603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39800/0x7ef423838fba4a60 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820050:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:0.0:1787384848.820054:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384848.820074:0:25603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39800/0x7ef423838fba4a60 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820082:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39800/0x7ef423838fba4a60 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820101:0:25603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a67 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x39804225 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820108:0:25603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a67 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x39804225 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820113:0:25603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a67 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x39804225 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820118:0:25603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384848.820120:0:25603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a67 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x39804225 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820126:0:25603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a67 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x39804225 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820132:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x39804225 (ffff98f7c3a9dd00) 00010000:00010000:0.0:1787384848.820135:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384848.820137:0:25603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a67 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x39804225 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.820143:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a67 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x39804225 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384848.820269:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+39:18884:x1874208182413184:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 1738us (3107us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384848.820289:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 61 00000100:00100000:3.0:1787384848.823202:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203489152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384848.823202:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203489024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384848.823295:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384848.823809:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384848.823942:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203489152 00000100:00100000:0.0:1787384848.823952:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203489152 00000100:00100000:0.0:1787384848.824014:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203489024 00000100:00100000:0.0:1787384848.824017:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203489024 00000100:00100000:0.0:1787384848.824037:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787384848.824046:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203489152:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384848.824065:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787384848.824075:0:25210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203489024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787384848.824091:0:22718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000004:00000024:3.0:1787384848.824095:0:25210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787384848.825769:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203489152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1713us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384848.825770:0:25210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203489024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1699us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384848.825802:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787384848.825890:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787384848.826040:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203489152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384848.826058:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203489024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384848.826125:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384848.826234:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182413312 00000100:00100000:3.0:1787384848.826241:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182413312 00000100:00100000:3.0:1787384848.826306:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:3.0:1787384848.826315:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+39:18884:x1874208182413312:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384848.826337:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384848.826385:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a6e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e7f expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.826431:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38800/0x7ef423838fba4a75 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.826446:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38800/0x7ef423838fba4a75 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.826462:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38800/0x7ef423838fba4a75 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.827067:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39a00/0x7ef423838fba4a6e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e7f expref: 41 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.827095:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38800/0x7ef423838fba4a75 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e7f expref: 40 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.827106:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98f8f5718900) 00010000:00010000:2.0:1787384848.827110:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787384848.827114:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8cad38800, rc 0) 00000100:00100000:2.0:1787384848.827291:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+40:18884:x1874208182413312:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 976us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384848.827298:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:1.0:1787384848.832221:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.832346:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182413568 00000100:00100000:0.0:1787384848.832361:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182413568 00000100:00100000:0.0:1787384848.832439:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:0.0:1787384848.832451:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+40:18884:x1874208182413568:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787384848.832564:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4a7c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.832586:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4a7c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.832600:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4a7c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384848.833156:0:22712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1787384848.833171:0:22712:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743913391679ns, next at 744913388181ns, rc = 0 00000004:00010000:0.0:1787384848.833235:0:22712:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f01135d4 reply state 000000000c2f5575 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4a7c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.833275:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4a7c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.833284:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98f8f5718900) 00010000:00010000:0.0:1787384848.833287:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787384848.833291:0:22712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384848.833424:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+42:18884:x1874208182413568:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 974us (1216us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1787384848.833432:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:1.0:1787384848.836717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.837098:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182413696 00000100:00100000:0.0:1787384848.837112:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182413696 00000100:00100000:0.0:1787384848.837188:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:0.0:1787384848.837199:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+42:18884:x1874208182413696:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384848.837230:0:25603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384848.837256:0:25603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a83 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e86 expref: -99 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.837331:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a83 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e86 expref: 43 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.837348:0:25603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a83 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e86 expref: 43 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.837372:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98f8f5718900) 00010000:00010000:0.0:1787384848.837375:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384848.837379:0:25603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd800, rc 0) 00000100:00100000:0.0:1787384848.837466:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+43:18884:x1874208182413696:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 269us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384848.837493:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:1.0:1787384848.841203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.841396:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182413824 00000100:00100000:0.0:1787384848.841410:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182413824 00000100:00100000:0.0:1787384848.841486:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:0.0:1787384848.841499:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:348c65a2-a652-4219-ac42-befa509a5d50+5:2414:x1874208182413824:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787384848.842177:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:348c65a2-a652-4219-ac42-befa509a5d50+6:2414:x1874208182413824:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 Request processed in 678us (986us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1787384848.842188:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:2.0:1787384848.845150:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384848.845268:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182414080 00000100:00100000:3.0:1787384848.845282:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182414080 00000100:00100000:3.0:1787384848.845391:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:3.0:1787384848.845403:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+43:18884:x1874208182414080:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787384848.845708:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+44:18884:x1874208182414080:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 307us (572us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1787384848.845716:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:1.0:1787384848.853495:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384848.854248:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182414336 00000100:00100000:2.0:1787384848.854265:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182414336 00000100:00100000:2.0:1787384848.854424:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:2.0:1787384848.854437:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+44:18884:x1874208182414336:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787384848.854639:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+44:18884:x1874208182414336:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 204us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384848.854647:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:3.0:1787384848.857434:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.857529:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182414464 00000100:00100000:0.0:1787384848.857543:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182414464 00000100:00100000:0.0:1787384848.857621:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:0.0:1787384848.857632:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+44:18884:x1874208182414464:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384848.857659:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384848.857685:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd200/0x7ef423838fba4a8a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e8d expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.857841:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4a91 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.857859:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4a91 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.857872:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4a91 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384848.857932:0:22712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384848.857966:0:22712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4a91 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.858021:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd200/0x7ef423838fba4a8a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e8d expref: 46 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.858043:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4a91 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e8d expref: 45 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.858053:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98f8f5718900) 00010000:00010000:0.0:1787384848.858056:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787384848.858061:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc400, rc 0) 00000100:00100000:0.0:1787384848.858629:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+45:18884:x1874208182414464:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 995us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384848.858638:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:0.0:1787384848.863042:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384848.863233:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182414592 00000100:00100000:3.0:1787384848.863246:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182414592 00000100:00100000:3.0:1787384848.863311:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:3.0:1787384848.863322:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+6:2415:x1874208182414592:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384848.863348:0:24220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384848.863376:0:24220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea038151/0x7ef423838fba4a98 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e94 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384848.863410:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a895410, blocks: 0x0 00010000:00010000:3.0:1787384848.863452:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1787384848.863457:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384848.863470:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea038151/0x7ef423838fba4a98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e94 expref: 7 pid: 24220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.863494:0:24220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea038151/0x7ef423838fba4a98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e94 expref: 7 pid: 24220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.863511:0:24220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8cad38c00, rc 0) 00000100:00100000:3.0:1787384848.863584:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+7:2415:x1874208182414592:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 262us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384848.863592:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:0.0:1787384848.867600:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384848.867719:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182414848 00000100:00100000:1.0:1787384848.868146:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182414848 00000100:00100000:0.0:1787384848.868365:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:0.0:1787384848.868378:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+45:18884:x1874208182414848:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787384848.868529:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:348c65a2-a652-4219-ac42-befa509a5d50+45:18884:x1874208182414848:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 152us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384848.868537:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:2.0:1787384848.871637:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384848.871932:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182414976 00000100:00100000:1.0:1787384848.871945:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182414976 00000100:00100000:1.0:1787384848.872036:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 68 00000100:00100000:1.0:1787384848.872048:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+45:18884:x1874208182414976:12345-192.168.203.45@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787384848.874355:0:22692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:3.0:1787384848.874378:0:22692:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787384848.874460:0:22692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:2.0:1787384848.874614:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825e00/0x7ef423838fba48ae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.874628:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825e00/0x7ef423838fba48ae lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.874637:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825e00/0x7ef423838fba48ae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.874644:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384848.874650:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825e00/0x7ef423838fba48ae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.874658:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825e00/0x7ef423838fba48ae lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.874679:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:2.0:1787384848.874683:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787384848.874688:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825e00/0x7ef423838fba48ae lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.874695:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825e00/0x7ef423838fba48ae lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384848.875494:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203489280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787384848.875584:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384848.876088:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5824a00/0x7ef423838fba485a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876100:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5824a00/0x7ef423838fba485a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876108:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5824a00/0x7ef423838fba485a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876114:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384848.876119:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5824a00/0x7ef423838fba485a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876128:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5824a00/0x7ef423838fba485a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876143:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff98f8f5718600) 00010000:00010000:1.0:1787384848.876146:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384848.876150:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5824a00/0x7ef423838fba485a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876157:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5824a00/0x7ef423838fba485a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876181:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825600/0x7ef423838fba4861 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876186:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825600/0x7ef423838fba4861 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876198:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825600/0x7ef423838fba4861 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876204:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384848.876207:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825600/0x7ef423838fba4861 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876213:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825600/0x7ef423838fba4861 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876220:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:1.0:1787384848.876222:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384848.876225:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825600/0x7ef423838fba4861 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876230:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f5825600/0x7ef423838fba4861 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876242:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031400/0x7ef423838fba4909 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876248:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031400/0x7ef423838fba4909 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876254:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031400/0x7ef423838fba4909 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876259:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384848.876261:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031400/0x7ef423838fba4909 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876275:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031400/0x7ef423838fba4909 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876283:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff98f8e8aa4e00) 00010000:00010000:1.0:1787384848.876286:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384848.876288:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031400/0x7ef423838fba4909 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876294:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031400/0x7ef423838fba4909 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876312:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39000/0x7ef423838fba498e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876318:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39000/0x7ef423838fba498e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876324:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39000/0x7ef423838fba498e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876329:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8cad39000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384848.876331:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39000/0x7ef423838fba498e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876337:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39000/0x7ef423838fba498e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876343:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:1.0:1787384848.876345:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384848.876347:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39000/0x7ef423838fba498e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876357:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad39000/0x7ef423838fba498e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876369:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba49b1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876374:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba49b1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876380:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba49b1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876385:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384848.876387:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba49b1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876393:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba49b1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876399:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:1.0:1787384848.876401:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384848.876404:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba49b1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876409:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba49b1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876417:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38000/0x7ef423838fba49f7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876423:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38000/0x7ef423838fba49f7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876432:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38000/0x7ef423838fba49f7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876437:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8cad38000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384848.876440:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38000/0x7ef423838fba49f7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876446:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38000/0x7ef423838fba49f7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876463:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:1.0:1787384848.876466:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384848.876468:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38000/0x7ef423838fba49f7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876474:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8cad38000/0x7ef423838fba49f7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876488:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4a7c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876494:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4a7c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876500:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4a7c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876505:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384848.876507:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4a7c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876522:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4a7c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876530:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98f8f5718900) 00010000:00010000:1.0:1787384848.876532:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787384848.876534:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4a7c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.876540:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4a7c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384848.877513:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203489280 00000100:00100000:0.0:1787384848.877526:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203489280 00000100:00100000:0.0:1787384848.877598:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787384848.877610:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203489280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787384848.877847:0:24218:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787384848.877851:0:24218:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787384848.877867:0:24218:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787384848.877869:0:24218:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787384848 -> 1787384848 00002000:00010000:0.0:1787384848.877872:0:24218:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787384848.877951:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1874208203489280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 343us (2367us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787384848.877960:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1787384848.878200:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f8f91da680/2, rc 0, transno 12884901892 00000100:00100000:2.0:1787384848.878215:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203489280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787384848.878579:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+14:18884:x1874208182414976:12345-192.168.203.45@tcp:44:lhsmtool_posix.0 Request processed in 4682us (5104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384848.878599:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 68 00000100:00100000:3.0:1787384848.881102:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.881366:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182415104 00000100:00100000:0.0:1787384848.881381:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182415104 00000100:00100000:0.0:1787384848.881463:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:0.0:1787384848.881477:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+7:2416:x1874208182415104:12345-192.168.203.45@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787384848.881624:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+7:2416:x1874208182415104:12345-192.168.203.45@tcp:16:lhsmtool_posix.0 Request processed in 150us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384848.881633:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:3.0:1787384848.884914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.885145:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182415360 00000100:00100000:0.0:1787384848.885159:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182415360 00000100:00100000:0.0:1787384848.885235:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:0.0:1787384848.885248:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+14:18884:x1874208182415360:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787384848.885320:0:25603:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384848.885356:0:25603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4a91 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e8d expref: 14 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.885381:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98f8f5718900) 00010000:00010000:0.0:1787384848.885387:0:25603:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384848.885427:0:25603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd200/0x7ef423838fba4a9f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.885443:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd200/0x7ef423838fba4a9f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.885475:0:25603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd200/0x7ef423838fba4a9f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384848.885644:0:25603:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075927068 reply state 00000000e115d7b2 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd200/0x7ef423838fba4a9f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.885763:0:25603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd200/0x7ef423838fba4a9f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.885773:0:25603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98f8f5718900) 00010000:00010000:0.0:1787384848.885814:0:25603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384848.885818:0:25603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384848.885966:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+15:18884:x1874208182415360:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 719us (1065us total) trans 12884901919 rc 0/0 00000100:00100000:0.0:1787384848.885976:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:3.0:1787384848.893199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.894035:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182415488 00000100:00100000:0.0:1787384848.894050:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182415488 00000100:00100000:0.0:1787384848.894136:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:0.0:1787384848.894149:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:348c65a2-a652-4219-ac42-befa509a5d50+7:18884:x1874208182415488:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384848.894174:0:24218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384848.894199:0:24218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3e9b expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.894242:0:24218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea038151/0x7ef423838fba4a98 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e94 expref: 8 pid: 24220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.894252:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384848.894275:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384848.894282:0:24218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e9b expref: 8 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.894330:0:24218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea038151/0x7ef423838fba4a98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e94 expref: 8 pid: 24220 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.894346:0:24218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea038151/0x7ef423838fba4a98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e94 expref: 8 pid: 24220 timeout: 843 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384848.894365:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24218:1874208203489408:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384848.894586:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384848.902314:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.902463:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24218:1874208203489408:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384848.902509:0:24218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e9b expref: 8 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.902537:0:24218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc400, rc 0) 00000100:00100000:0.0:1787384848.902618:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:348c65a2-a652-4219-ac42-befa509a5d50+8:18884:x1874208182415488:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 8471us (9435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384848.902628:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:1.0:1787384848.903017:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182415616 00000100:00100000:1.0:1787384848.903026:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182415616 00010000:00010000:1.0:1787384848.903069:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea038151/0x7ef423838fba4a98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e94 expref: 8 pid: 24220 timeout: 843 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384848.903110:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:1.0:1787384848.903121:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:348c65a2-a652-4219-ac42-befa509a5d50+8:2416:x1874208182415616:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384848.903138:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384848.903164:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea038151/0x7ef423838fba4a98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e94 expref: 8 pid: 24220 timeout: 843 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.903180:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea038151/0x7ef423838fba4a98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e94 expref: 8 pid: 24220 timeout: 843 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.903236:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea038151/0x7ef423838fba4a98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e94 expref: 8 pid: 24220 timeout: 843 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.903255:0:22698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384848.903260:0:22698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384848.903268:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e9b expref: 7 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.903280:0:22698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e9b expref: 7 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384848.903322:0:22698:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e9b expref: 7 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384848.903338:0:22698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22698:1874208203489536:192.168.203.45@tcp:105: 00000100:00100000:1.0:1787384848.903414:0:22698:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e8a05cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384848.919430:0:22698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22698:1874208203489536:192.168.203.45@tcp:105: 00010000:00010000:0.0:1787384848.919470:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384848.919545:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:348c65a2-a652-4219-ac42-befa509a5d50+7:2416:x1874208182415616:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 16424us (17243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384848.919559:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:2.0:1787384848.923112:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.923220:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182415744 00000100:00100000:0.0:1787384848.923232:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182415744 00000100:00100000:0.0:1787384848.923358:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:0.0:1787384848.923371:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+7:2416:x1874208182415744:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787384848.923571:0:24220:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787384848.923575:0:24220:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787384847 00002000:00010000:0.0:1787384848.923578:0:24220:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787384845 00002000:00010000:0.0:1787384848.923580:0:24220:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787384848 -> 1787384847 00002000:00010000:0.0:1787384848.923583:0:24220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787384848.923668:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+8:2416:x1874208182415744:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 Request processed in 300us (569us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787384848.923676:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:2.0:1787384848.941023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384848.941216:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182415872 00000100:00100000:3.0:1787384848.941230:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182415872 00000100:00100000:3.0:1787384848.941312:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:3.0:1787384848.941323:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:348c65a2-a652-4219-ac42-befa509a5d50+8:2413:x1874208182415872:12345-192.168.203.45@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787384848.941386:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.941428:0:24221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e9b expref: 8 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.941438:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787384848.941443:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384848.941448:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.941491:0:24221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e9b expref: 8 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.941507:0:24221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e9b expref: 8 pid: 24218 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384848.941526:0:24221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee288000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24221:1874208203489664:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384848.941627:0:24221:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8cb0736c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384848.963407:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384848.963517:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182416000 00000100:00100000:2.0:1787384848.963530:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182416000 00010000:00010000:2.0:1787384848.963587:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e9b expref: 9 pid: 24218 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384848.963638:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:2.0:1787384848.963649:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:348c65a2-a652-4219-ac42-befa509a5d50+9:2416:x1874208182416000:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384848.963667:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384848.963693:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e9b expref: 9 pid: 24218 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.963709:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e9b expref: 9 pid: 24218 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.963755:0:22699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384848.963760:0:22699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384848.963767:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.963832:0:22699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.963859:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384848.963940:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:348c65a2-a652-4219-ac42-befa509a5d50+9:2416:x1874208182416000:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 292us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384848.964176:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00010000:00010000:0.0:1787384848.964673:0:24221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4aa6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e9b expref: 8 pid: 24218 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384848.964692:0:24221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee288000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24221:1874208203489664:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384848.964718:0:24221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.964744:0:24221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.964752:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.964857:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.964878:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.964887:0:24221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.964896:0:24221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8cad39400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384848.964901:0:24221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.964911:0:24221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.964930:0:24221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384848.964939:0:24221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000545d62be/0x7ef423838fba4aad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384848.965049:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:348c65a2-a652-4219-ac42-befa509a5d50+7:2413:x1874208182415872:12345-192.168.203.45@tcp:1:lhsmtool_posix.0 Request processed in 23728us (24043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384848.965059:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:3.0:1787384848.981764:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384848.985602:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182416256 00000100:00100000:2.0:1787384848.985625:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182416256 00000100:00100000:2.0:1787384848.985761:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 70 00000100:00100000:2.0:1787384848.985773:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+15:18884:x1874208182416256:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787384848.985934:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.985966:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cde00/0x7ef423838fba4987 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e39 expref: 15 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.985981:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.986031:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cde00/0x7ef423838fba4987 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e39 expref: 15 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.986049:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cde00/0x7ef423838fba4987 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e39 expref: 15 pid: 22712 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384848.986067:0:22712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f07480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22712:1874208203489792:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384848.986178:0:22712:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1dcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384848.989893:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384848.990049:0:22712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f07480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22712:1874208203489792:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384848.990084:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384848.990191:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182416384 00000100:00100000:3.0:1787384848.990200:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182416384 00010000:00010000:3.0:1787384848.990252:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cde00/0x7ef423838fba4987 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e39 expref: 16 pid: 22712 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384848.990292:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:3.0:1787384848.990302:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:348c65a2-a652-4219-ac42-befa509a5d50+16:2415:x1874208182416384:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384848.990329:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384848.990338:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cde00/0x7ef423838fba4987 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e39 expref: 16 pid: 22712 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.990353:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cde00/0x7ef423838fba4987 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e39 expref: 16 pid: 22712 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.990380:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cde00/0x7ef423838fba4987 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e39 expref: 16 pid: 22712 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.990397:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:3.0:1787384848.990402:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba4a1a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e6a expref: 15 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.990412:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.990420:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.990427:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384848.990458:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384848.990519:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:348c65a2-a652-4219-ac42-befa509a5d50+15:2415:x1874208182416384:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 218us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384848.990527:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 22 00010000:00010000:2.0:1787384848.993688:0:22712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.993711:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.994358:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.994383:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a83 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e86 expref: 15 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.994391:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.994449:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a83 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e86 expref: 15 pid: 25603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384848.994467:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a83 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e86 expref: 15 pid: 25603 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384848.994486:0:22712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f07480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22712:1874208203489920:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384848.994613:0:22712:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d97ccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384849.003219:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384849.003360:0:22712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f07480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22712:1874208203489920:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384849.003395:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384849.003526:0:25759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182416512 00000100:00100000:3.0:1787384849.003535:0:25759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182416512 00010000:00010000:3.0:1787384849.003622:0:25759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a83 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e86 expref: 16 pid: 25603 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384849.003678:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:3.0:1787384849.003690:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c405e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:348c65a2-a652-4219-ac42-befa509a5d50+16:2416:x1874208182416512:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384849.003710:0:25759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384849.003719:0:25759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a83 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e86 expref: 16 pid: 25603 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384849.003732:0:25759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a83 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e86 expref: 16 pid: 25603 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384849.003770:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba4a83 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e86 expref: 16 pid: 25603 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384849.003837:0:25759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98f8f5718900) 00010000:00010000:3.0:1787384849.003843:0:25759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384849.003855:0:25759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384849.003863:0:25759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384849.003886:0:25759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384849.004047:0:22712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.004055:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384849.004200:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:0.0:1787384849.004335:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:0.0:1787384849.004375:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:0.0:1787384849.004494:0:22712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22712:1874208203490048:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787384849.004563:0:22712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384849.004595:0:22712:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384849.004991:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c405e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:348c65a2-a652-4219-ac42-befa509a5d50+15:2416:x1874208182416512:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 261us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384849.005006:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00080000:2.0:1787384849.006539:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384849.006571:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203490048 00000100:00100000:2.0:1787384849.006584:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203490048 00000100:00100000:2.0:1787384849.006865:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787384849.006880:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22712:x1874208203490048:12345-0@lo:1000:mdt00_000.0 00000100:00080000:0.0:1787384849.007063:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384849.007638:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22712:x1874208203490048:12345-0@lo:1000:mdt00_000.0 Request processed in 758us (3069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384849.007650:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787384849.008992:0:22712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22712:1874208203490048:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787384849.009254:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:0.0:1787384849.009358:0:22712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22712:1874208203490176:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787384849.011569:0:22712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384849.011648:0:22712:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462000 going to sleep for 11 seconds 00000100:00100000:2.0:1787384849.014160:0:25210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203490176 00000100:00100000:2.0:1787384849.014229:0:25210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203490176 00000100:00100000:2.0:1787384849.014349:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787384849.014368:0:25210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22712:x1874208203490176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787384849.014976:0:25210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22712:x1874208203490176:12345-0@lo:1000:mdt00_000.0 Request processed in 607us (3411us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1787384849.014992:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787384849.016896:0:22712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22712:1874208203490176:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787384849.017016:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017036:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017073:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017079:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c148c200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384849.017084:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017094:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017116:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98f8f5718900) 00010000:00010000:0.0:1787384849.017120:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384849.017125:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017132:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c200/0x7ef423838fba4abb lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017180:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4a13 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017187:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4a13 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017192:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4a13 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017196:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384849.017199:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4a13 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017217:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4a13 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017226:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384849.017228:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384849.017236:0:22712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba4a1a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e6a expref: 18 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017248:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba4a1a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e6a expref: 18 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017256:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba4a1a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e6a expref: 18 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.017332:0:22712:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58ccc00/0x7ef423838fba4a1a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3e6a expref: 18 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384849.017355:0:22712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22712:1874208203490304:192.168.203.45@tcp:105: 00000100:00100000:0.0:1787384849.017882:0:22712:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384849.023384:0:22712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22712:1874208203490304:192.168.203.45@tcp:105: 00010000:00010000:0.0:1787384849.023428:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4a13 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023440:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030c00/0x7ef423838fba4a13 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023487:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4ac2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023512:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4ac2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023525:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4ac2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023537:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4ac2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023544:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4ac2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023550:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4ac2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023556:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384849.023562:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4ac2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023571:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4ac2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023584:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384849.023587:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384849.023591:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4ac2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023597:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4ac2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023607:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023620:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023627:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023632:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c148d000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384849.023635:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023642:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023651:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384849.023653:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384849.023656:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.023662:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba4ab4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384849.023912:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+18:18884:x1874208182416256:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 38139us (42175us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1787384849.023924:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 70 00000020:00080000:0.0:1787384849.023933:0:22712:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787384849.024108:0:22748:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787384849.024115:0:22748:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384849.024135:0:22748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787384849.024143:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787384849.026224:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384849.026329:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182416640 00000100:00100000:2.0:1787384849.026342:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182416640 00000100:00100000:2.0:1787384849.026415:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:2.0:1787384849.026427:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348c65a2-a652-4219-ac42-befa509a5d50+18:18883:x1874208182416640:12345-192.168.203.45@tcp:49:bash.0 00000100:00100000:3.0:1787384849.026530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384849.026602:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348c65a2-a652-4219-ac42-befa509a5d50+18:18883:x1874208182416640:12345-192.168.203.45@tcp:49:bash.0 Request processed in 177us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384849.026610:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:2.0:1787384849.026627:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182416896 00000100:00100000:2.0:1787384849.026630:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182416896 00000100:00100000:2.0:1787384849.026645:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 13 00000100:00100000:2.0:1787384849.026650:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348c65a2-a652-4219-ac42-befa509a5d50+18:18884:x1874208182416896:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787384849.027021:0:22716:0:(mdd_object.c:4010:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787384849.027065:0:22716:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:2.0:1787384849.027107:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4ac9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.027127:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4ac9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.027141:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4ac9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.027172:0:22716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4ac9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.027180:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4ac9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.027187:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4ac9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.027207:0:22716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787384849.027270:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348c65a2-a652-4219-ac42-befa509a5d50+20:18884:x1874208182416896:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 618us (740us total) trans 12884901926 rc 0/0 00000100:00100000:2.0:1787384849.027278:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 13 00000020:00080000:2.0:1787384849.027282:0:22716:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787384849.028208:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384849.028221:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4ac9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384849.028233:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c148d800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384849.028238:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4ac9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384849.028248:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4ac9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384849.028269:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff98f8f5718900) 00010000:00010000:3.0:1787384849.028272:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787384849.028278:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4ac9 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384849.028284:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d800/0x7ef423838fba4ac9 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384849.028305:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384849.028308:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384849.028309:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384849.037964:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384849.038672:0:24638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182417024 00000100:00100000:0.0:1787384849.038686:0:24638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182417024 00000100:00100000:0.0:1787384849.038848:0:24638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:0.0:1787384849.038864:0:24638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:348c65a2-a652-4219-ac42-befa509a5d50+7:18883:x1874208182417024:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384849.038914:0:24638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384849.038954:0:24638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4ad0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3ea2 expref: -99 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384849.038990:0:24638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a89540f, atime: 0x6a89540d, ctime: 0x6a89540f, blocks: 0x0 00010000:00010000:0.0:1787384849.039018:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=744s v=(0 0) 00010000:00010000:0.0:1787384849.039024:0:24638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384849.039037:0:24638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4ad0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ea2 expref: 8 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.039055:0:24638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba4ad0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ea2 expref: 8 pid: 24638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.039069:0:24638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc400, rc 0) 00000100:00100000:0.0:1787384849.039149:0:24638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:348c65a2-a652-4219-ac42-befa509a5d50+8:18883:x1874208182417024:12345-192.168.203.45@tcp:101:bash.0 Request processed in 291us (1202us total) trans 0 rc 0/0 00000100:00080000:2.0:1787384849.039207:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384849.051699:0:24638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:1.0:1787384849.054040:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384849.054146:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182417152 00000100:00100000:2.0:1787384849.054160:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182417152 00000100:00100000:2.0:1787384849.054239:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:2.0:1787384849.054250:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+20:18883:x1874208182417152:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:2.0:1787384849.054286:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384849.054314:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c800/0x7ef423838fba4ad7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3ea9 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.054358:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148da00/0x7ef423838fba4ade lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.054374:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148da00/0x7ef423838fba4ade lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.054407:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148da00/0x7ef423838fba4ade lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.055126:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c800/0x7ef423838fba4ad7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ea9 expref: 22 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.055156:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148da00/0x7ef423838fba4ade lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ea9 expref: 21 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.055167:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384849.055171:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787384849.055175:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c148da00, rc 0) 00000100:00100000:2.0:1787384849.055304:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+21:18883:x1874208182417152:12345-192.168.203.45@tcp:101:bash.0 Request processed in 1054us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384849.055314:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:1.0:1787384849.067529:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384849.068082:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182417408 00000100:00100000:2.0:1787384849.068096:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182417408 00000100:00100000:2.0:1787384849.068174:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00100000:2.0:1787384849.068186:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348c65a2-a652-4219-ac42-befa509a5d50+21:18883:x1874208182417408:12345-192.168.203.45@tcp:35:bash.0 00000001:00080000:2.0:1787384849.068485:0:22716:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1787384849.070025:0:22716:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1787384849.070193:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:348c65a2-a652-4219-ac42-befa509a5d50+24:18883:x1874208182417408:12345-192.168.203.45@tcp:35:bash.0 Request processed in 2005us (2675us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1787384849.070204:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 14 00000020:00080000:2.0:1787384849.070210:0:22716:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787384849.182416:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384849.183148:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182417664 00000100:00100000:2.0:1787384849.183163:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182417664 00000100:00100000:2.0:1787384849.183246:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00100000:2.0:1787384849.183256:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348c65a2-a652-4219-ac42-befa509a5d50+24:18894:x1874208182417664:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384849.183280:0:25506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384849.183301:0:25506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c800/0x7ef423838fba4ae5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3eb0 expref: -99 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384849.183394:0:25506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787384849.183496:0:25506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c800/0x7ef423838fba4ae5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3eb0 expref: 26 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.183523:0:25506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9de00) 00010000:00010000:2.0:1787384849.183526:0:25506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384849.183532:0:25506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148c800/0x7ef423838fba4ae5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3eb0 expref: 26 pid: 25506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384849.183547:0:25506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c148c800, rc 0) 00000100:00100000:2.0:1787384849.183614:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:348c65a2-a652-4219-ac42-befa509a5d50+25:18894:x1874208182417664:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 360us (1214us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1787384849.183621:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00100000:1.0:1787384849.187538:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384849.187670:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182417792 00000100:00100000:0.0:1787384849.187684:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182417792 00000100:00100000:0.0:1787384849.187761:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 73 00000100:00100000:0.0:1787384849.187772:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+25:18894:x1874208182417792:12345-192.168.203.45@tcp:34:lfs.0 00010000:00010000:0.0:1787384849.187907:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba4af3 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.187928:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba4af3 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.187974:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba4af3 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.187995:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4afa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188003:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4afa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188010:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4afa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188108:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba4b01 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188119:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba4b01 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188126:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba4b01 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384849.188182:0:22712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba4b01 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188197:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba4af3 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188204:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba4af3 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188211:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba4af3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188228:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cda00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384849.188233:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba4af3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188242:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba4af3 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188255:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff98f8f5718300) 00010000:00010000:0.0:1787384849.188259:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384849.188264:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba4af3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188271:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba4af3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188286:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4afa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188292:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4afa lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188298:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4afa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188303:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384849.188306:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4afa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188313:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4afa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188332:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff98f7c3a9d000) 00010000:00010000:0.0:1787384849.188335:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384849.188338:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4afa lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188344:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba4afa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188360:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba4b01 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188366:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba4b01 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188372:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba4b01 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188376:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384849.188379:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba4b01 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188385:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba4b01 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188392:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384849.188395:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384849.188398:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba4b01 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384849.188404:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc200/0x7ef423838fba4b01 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384849.188510:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:348c65a2-a652-4219-ac42-befa509a5d50+25:18894:x1874208182417792:12345-192.168.203.45@tcp:34:lfs.0 Request processed in 738us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384849.188523:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 73 00000100:00100000:3.0:1787384849.191533:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384849.191637:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182418048 00000100:00100000:0.0:1787384849.191647:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182418048 00000100:00100000:0.0:1787384849.191705:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:0.0:1787384849.191714:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+25:18894:x1874208182418048:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:0.0:1787384849.191995:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:348c65a2-a652-4219-ac42-befa509a5d50+26:18894:x1874208182418048:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 280us (470us total) trans 12884901931 rc 0/0 00000100:00100000:0.0:1787384849.192003:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 15 00010000:00010000:0.0:1787384849.271067:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384850.038987:0:22748:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787384850.038997:0:22748:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384850.039018:0:22748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787384850.039040:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1787384850.296713:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384850.870898:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384850.870919:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203490432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384850.870988:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871020:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203490816:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871045:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871063:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203491328:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871083:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871112:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203491840:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871134:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871151:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787384850.871156:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203490944:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871174:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871189:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203491456:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871207:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871221:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203491968:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871239:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871262:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203490688:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871284:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871300:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203491200:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871320:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871335:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203491712:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871353:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871382:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787384850.871388:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203490560:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871412:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871438:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203491072:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871476:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871494:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203491584:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871512:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871526:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203492096:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871542:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.871564:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203490432 00000100:00100000:1.0:1787384850.871571:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203490432 00000100:00100000:1.0:1787384850.871620:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787384850.871628:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203490432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384850.871655:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787384850.871695:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203490432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.871702:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787384850.871724:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203490816 00000100:00100000:1.0:1787384850.871727:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203490816 00000100:00100000:1.0:1787384850.871744:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203491328 00000100:00100000:1.0:1787384850.871747:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203491328 00000100:00100000:1.0:1787384850.871758:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203490944 00000100:00100000:1.0:1787384850.871760:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203490944 00000100:00100000:1.0:1787384850.871769:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203491456 00000100:00100000:1.0:1787384850.871771:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203491456 00000100:00100000:1.0:1787384850.871807:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787384850.871824:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3653:x1874208203490816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871855:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3653:x1874208203490816:12345-0@lo:400:kworker.0 Request processed in 42us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.871862:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787384850.871875:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384850.871881:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203491328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871916:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203491328:12345-0@lo:400:kworker.0 Request processed in 35us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.871922:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384850.871934:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384850.871939:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203490944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.871962:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203490944:12345-0@lo:400:kworker.0 Request processed in 23us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.871968:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384850.871978:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384850.871984:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203491456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872006:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203491456:12345-0@lo:400:kworker.0 Request processed in 22us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.872012:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384850.872031:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203491840 00000100:00100000:1.0:1787384850.872035:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203491840 00000100:00100000:1.0:1787384850.872054:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203491968 00000100:00100000:1.0:1787384850.872057:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203491968 00000100:00100000:1.0:1787384850.872068:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203491712 00000100:00100000:1.0:1787384850.872070:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203491712 00000100:00100000:1.0:1787384850.872082:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203491072 00000100:00100000:1.0:1787384850.872085:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203491072 00000100:00100000:1.0:1787384850.872095:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203491584 00000100:00100000:1.0:1787384850.872097:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203491584 00000100:00100000:1.0:1787384850.872106:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203492096 00000100:00100000:1.0:1787384850.872108:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203492096 00000100:00100000:1.0:1787384850.872121:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787384850.872127:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203491840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872155:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203491840:12345-0@lo:400:kworker.0 Request processed in 28us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.872166:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787384850.872177:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787384850.872182:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203491968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872204:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203491968:12345-0@lo:400:kworker.0 Request processed in 22us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.872209:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787384850.872218:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787384850.872222:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203491712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872246:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203491712:12345-0@lo:400:kworker.0 Request processed in 24us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.872251:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787384850.872260:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787384850.872265:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203491072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872285:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203491072:12345-0@lo:400:kworker.0 Request processed in 20us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.872290:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787384850.872300:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384850.872306:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203491584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872331:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203491584:12345-0@lo:400:kworker.0 Request processed in 26us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.872337:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384850.872346:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787384850.872352:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203492096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872374:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203492096:12345-0@lo:400:kworker.0 Request processed in 22us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.872384:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787384850.872405:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203490688 00000100:00100000:1.0:1787384850.872408:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203490688 00000100:00100000:1.0:1787384850.872428:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203491200 00000100:00100000:1.0:1787384850.872430:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203491200 00000100:00100000:1.0:1787384850.872440:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787384850.872444:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203490688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872472:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203490688:12345-0@lo:400:kworker.0 Request processed in 27us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.872477:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787384850.872485:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787384850.872490:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203491200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872509:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203491200:12345-0@lo:400:kworker.0 Request processed in 19us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.872514:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787384850.872534:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203490560 00000100:00100000:1.0:1787384850.872536:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203490560 00000100:00100000:1.0:1787384850.872556:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787384850.872561:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+24:3652:x1874208203490560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872584:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a654d8f2-2ab4-4025-870e-e3edf79de730+24:3652:x1874208203490560:12345-0@lo:400:kworker.0 Request processed in 22us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.872589:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1787384850.872615:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384850.872619:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384850.872622:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384850.872624:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384850.872654:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a654d8f2-2ab4-4025-870e-e3edf79de730:3652:1874208203490560:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872673:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203491072:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872680:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203491584:0@lo:400:kworker.0 00010000:00080000:1.0:1787384850.872691:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee144700 x1874208203492096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384850.872701:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203492096:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872710:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203490688:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872719:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203491200:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872728:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203491712:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872758:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203492224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384850.872801:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384850.872841:0:25681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203492224 00000100:00100000:1.0:1787384850.872844:0:25681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203492224 00000100:00100000:1.0:1787384850.872864:0:25681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787384850.872869:0:25681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203492224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787384850.872881:0:25681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787384850.872908:0:25681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203492224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384850.872913:0:25681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787384850.872938:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203490944:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872947:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203491456:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872956:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203491968:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872979:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203490816:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.872989:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203491328:0@lo:400:kworker.0 00010000:00080000:1.0:1787384850.872998:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee146680 x1874208203491840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384850.873006:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203491840:0@lo:400:kworker.0 00000100:00100000:1.0:1787384850.873019:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203490432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384850.873053:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203492224:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1787384850.884169:0:25797:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1787384851.319069:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384852.335512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384852.335578:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384852.335617:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384852.335642:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384852.335758:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182418176 00000100:00100000:1.0:1787384852.335821:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182418176 00002000:00100000:1.0:1787384852.335906:0:24225:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff98f8ee289500 x1874208182418176/t0(0) o4->348c65a2-a652-4219-ac42-befa509a5d50@192.168.203.45@tcp:128/0 lens 504/0 e 0 to 0 dl 1787384863 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787384852.335920:0:24225:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8ee289500 with x1874208182418176 ext(0->8) 00002000:00010000:1.0:1787384852.335929:0:24225:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8ee289500 00000100:00100000:3.0:1787384852.335939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384852.335973:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:3.0:1787384852.335982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384852.335993:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:348c65a2-a652-4219-ac42-befa509a5d50+8:2416:x1874208182418176:12345-192.168.203.45@tcp:4:bash.0 00000100:00100000:2.0:1787384852.336059:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182418560 00000100:00100000:2.0:1787384852.336066:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182418560 00000100:00100000:2.0:1787384852.336110:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182419072 00000100:00100000:2.0:1787384852.336114:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182419072 00000100:00100000:2.0:1787384852.336140:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 70 00000100:00100000:2.0:1787384852.336148:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+26:2413:x1874208182418560:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384852.336259:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:348c65a2-a652-4219-ac42-befa509a5d50+26:2413:x1874208182418560:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 110us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384852.336288:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 70 00000100:00100000:2.0:1787384852.336310:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:2.0:1787384852.336317:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2413:x1874208182419072:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384852.336348:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2413:x1874208182419072:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 32us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384852.336354:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:3.0:1787384852.339336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384852.339370:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182418432 00000100:00100000:3.0:1787384852.339378:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182418432 00000100:00100000:0.0:1787384852.339406:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182418304 00000100:00100000:0.0:1787384852.339420:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182418304 00000100:00100000:3.0:1787384852.339572:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 168 00000100:00100000:3.0:1787384852.339585:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+13:2413:x1874208182418432:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384852.339656:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482831-3a49-488a-9a1d-d55fc29705fa+13:2413:x1874208182418432:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 73us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384852.339663:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 168 00000100:00100000:3.0:1787384852.339720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384852.339872:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384852.339913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384852.343472:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182418816 00000100:00100000:2.0:1787384852.343486:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182418816 00000100:00100000:3.0:1787384852.343533:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182418688 00000100:00100000:3.0:1787384852.343548:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182418688 00000100:00100000:2.0:1787384852.343554:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182419328 00000100:00100000:3.0:1787384852.343597:0:25603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182418944 00000100:00100000:3.0:1787384852.343601:0:25603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182418944 00000100:00100000:3.0:1787384852.343631:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00100000:3.0:1787384852.343640:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+5:2413:x1874208182418688:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384852.343687:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182419328 00000100:00100000:2.0:1787384852.343726:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182419200 00000100:00100000:2.0:1787384852.343729:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182419200 00000100:00100000:2.0:1787384852.343760:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00100000:3.0:1787384852.343772:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:348c65a2-a652-4219-ac42-befa509a5d50+5:2413:x1874208182418688:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 128us (4047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384852.343774:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:2413:x1874208182418816:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384852.343817:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00100000:3.0:1787384852.343863:0:25603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 73 00000100:00100000:3.0:1787384852.343872:0:25603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84891948-9b25-4376-8d8c-2664f1d91fdc+6:2413:x1874208182418944:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384852.343913:0:25603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84891948-9b25-4376-8d8c-2664f1d91fdc+6:2413:x1874208182418944:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 41us (4039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384852.343920:0:25603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 73 00000100:00100000:2.0:1787384852.343963:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:348c65a2-a652-4219-ac42-befa509a5d50+5:2413:x1874208182418816:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 192us (8317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384852.343972:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00100000:2.0:1787384852.343999:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:2.0:1787384852.344012:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2413:x1874208182419328:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384852.344040:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2413:x1874208182419328:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 34us (8065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384852.344048:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:2.0:1787384852.344059:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:2.0:1787384852.344066:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2413:x1874208182419200:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384852.344135:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84891948-9b25-4376-8d8c-2664f1d91fdc+5:2413:x1874208182419200:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 69us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384852.344142:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:3.0:1787384852.344162:0:24638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00080000:1.0:1787384852.344603:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384852.344610:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384852.344612:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384852.344614:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384852.344717:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:348c65a2-a652-4219-ac42-befa509a5d50+11:2416:x1874208182418176:12345-192.168.203.45@tcp:4:bash.0 Request processed in 8729us (9212us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787384852.344744:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 0 00002000:00100000:2.0:1787384852.344755:0:24225:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff98f8ee289500 x1874208182418176/t12884901895(0) o4->348c65a2-a652-4219-ac42-befa509a5d50@192.168.203.45@tcp:128/0 lens 504/448 e 0 to 0 dl 1787384863 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787384852.344764:0:24225:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8ee289500 with x1874208182418176 ext(0->8) 00002000:00010000:2.0:1787384852.344770:0:24225:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8ee289500 00000100:00100000:3.0:1787384852.348465:0:24638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:348c65a2-a652-4219-ac42-befa509a5d50+10:2416:x1874208182418304:12345-192.168.203.45@tcp:16:kworker.0 00010000:00010000:2.0:1787384852.348673:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787384852.354723:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:1.0:1787384852.354744:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000100:00100000:3.0:1787384852.355197:0:24638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:348c65a2-a652-4219-ac42-befa509a5d50+6:2416:x1874208182418304:12345-192.168.203.45@tcp:16:kworker.0 Request processed in 11011us (19604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384852.355214:0:24638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 32 Debug log: 14598 lines, 14598 kept, 0 dropped, 0 bad.